Jul 29 19:29:50.387509 ip-10-0-131-41 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 19:29:50.756827 ip-10-0-131-41 kubenswrapper[2531]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:29:50.756827 ip-10-0-131-41 kubenswrapper[2531]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 19:29:50.756827 ip-10-0-131-41 kubenswrapper[2531]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:29:50.756827 ip-10-0-131-41 kubenswrapper[2531]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 19:29:50.756827 ip-10-0-131-41 kubenswrapper[2531]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 19:29:50.759219 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.759136    2531 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 19:29:50.763264 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763250    2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:29:50.763264 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763264    2531 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763268    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763271    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763274    2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763277    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763280    2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763283    2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763286    2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763289    2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763292    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763294    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763297    2531 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763299    2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763302    2531 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763304    2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763307    2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763309    2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763317    2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763320    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763323    2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:29:50.763326 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763325    2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763327    2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763330    2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763333    2531 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763336    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763339    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763342    2531 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763344    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763347    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763349    2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763352    2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763354    2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763357    2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763359    2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763361    2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763364    2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763366    2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763369    2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763371    2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763374    2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:29:50.763798 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763377    2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763379    2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763381    2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763384    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763388    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763391    2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763393    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763396    2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763398    2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763400    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763403    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763405    2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763407    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763410    2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763413    2531 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763416    2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763418    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763421    2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763423    2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763426    2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:29:50.764276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763428    2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763431    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763433    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763436    2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763438    2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763440    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763443    2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763445    2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763448    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763450    2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763453    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763455    2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763458    2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763460    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763463    2531 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763465    2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763468    2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763470    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763472    2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763475    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:29:50.764771 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763477    2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763480    2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763482    2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763484    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763489    2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763493    2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763497    2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763501    2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763504    2531 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763508    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763510    2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763513    2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763515    2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763518    2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763520    2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763523    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763525    2531 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.763529    2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764223    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:29:50.765312 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764244    2531 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764248    2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764251    2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764253    2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764256    2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764259    2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764263    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764265    2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764268    2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764270    2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764272    2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764275    2531 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764277    2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764280    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764283    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764286    2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764289    2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764292    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764294    2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764298    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:29:50.765769 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764301    2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764304    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764306    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764309    2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764313    2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764317    2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764320    2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764323    2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764325    2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764328    2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764331    2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764333    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764336    2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764339    2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764341    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764343    2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764346    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764349    2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764351    2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:29:50.766276 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764353    2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764356    2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764359    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764361    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764363    2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764366    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764368    2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764370    2531 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764373    2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764377    2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764381    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764383    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764387    2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764390    2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764392    2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764394    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764397    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764399    2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764402    2531 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:29:50.766733 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764404    2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764406    2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764409    2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764411    2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764414    2531 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764416    2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764419    2531 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764421    2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764423    2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764426    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764429    2531 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764431    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764434    2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764437    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764440    2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764444    2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764447    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764450    2531 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764453    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764455    2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:29:50.767182 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764479    2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764482    2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764485    2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764488    2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764492    2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764505    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764508    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764511    2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764513    2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764516    2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764518    2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764521    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764523    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764526    2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764529    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764531    2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764534    2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764536    2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764539    2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764541    2531 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:29:50.767709 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764909    2531 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764915    2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764918    2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764921    2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764925    2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764928    2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764931    2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764933    2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764936    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764939    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764941    2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764944    2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764947    2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764949    2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764951    2531 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764954    2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764957    2531 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764960    2531 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764962    2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764965    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:29:50.768194 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764968    2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764970    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764973    2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764975    2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764978    2531 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764980    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764983    2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764985    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764988    2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764990    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764992    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764995    2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.764997    2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765000    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765002    2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765004    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765007    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765010    2531 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765012    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765017    2531 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765019    2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:29:50.768689 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765022    2531 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765024    2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765029    2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765032    2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765035    2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765038    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765040    2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765043    2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765047    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765049    2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765052    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765054    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765057    2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765059    2531 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765062    2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765064    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765067    2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765069    2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765072    2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:29:50.769203 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765075    2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765079    2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765081    2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765084    2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765087    2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765089    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765091    2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765094    2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765096    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765098    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765101    2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765105    2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765108    2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765110    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765113    2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765115    2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765118    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765121    2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765124    2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765126    2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:29:50.769687 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765128    2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765132    2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765134    2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765137    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765141    2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765144    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765147    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765149    2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765152    2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765154    2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765157    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765160    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765162    2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765165    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765167    2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765170    2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765172    2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765175    2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765177    2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:29:50.770161 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765258    2531 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765266    2531 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765280    2531 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765287    2531 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765299    2531 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765303    2531 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765307    2531 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765311    2531 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765314    2531 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765317    2531 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765320    2531 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765324    2531 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765327    2531 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765330    2531 flags.go:64] FLAG: --cgroup-root=""
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765333    2531 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765336    2531 flags.go:64] FLAG: --client-ca-file=""
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765339    2531 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765341    2531 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765346    2531 flags.go:64] FLAG: --cluster-domain=""
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765348    2531 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765351    2531 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765354    2531 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765357    2531 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765361    2531 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 19:29:50.770621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765364    2531 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765367    2531 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765370    2531 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765373    2531 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765376    2531 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765379    2531 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765382    2531 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765384    2531 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765388    2531 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765391    2531 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765394    2531 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765396    2531 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765400    2531 flags.go:64] FLAG: --enable-server="true"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765403    2531 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765407    2531 flags.go:64] FLAG: --event-burst="100"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765410    2531 flags.go:64] FLAG: --event-qps="50"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765413    2531 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765416    2531 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765419    2531 flags.go:64] FLAG: --eviction-hard=""
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765424    2531 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765427    2531 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765430    2531 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765433    2531 flags.go:64] FLAG: --eviction-soft=""
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765436    2531 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765438    2531 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 19:29:50.771271 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765441    2531 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765444    2531 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765446    2531 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765449    2531 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765452    2531 flags.go:64] FLAG: --feature-gates=""
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765455    2531 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765458    2531 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765461    2531 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765465    2531 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765467    2531 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765470    2531 flags.go:64] FLAG: --help="false"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765473    2531 flags.go:64] FLAG: --hostname-override="ip-10-0-131-41.ec2.internal"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765476    2531 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765479    2531 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765481    2531 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765484    2531 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765487    2531 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765490    2531 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765493    2531 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765496    2531 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765499    2531 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765502    2531 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765505    2531 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765508    2531 flags.go:64] FLAG: --kube-reserved=""
Jul 29 19:29:50.772401 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765511    2531 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765514    2531 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765517    2531 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765519    2531 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765522    2531 flags.go:64] FLAG: --lock-file=""
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765525    2531 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765528    2531 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765530    2531 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765536    2531 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765539    2531 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765541    2531 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765544    2531 flags.go:64] FLAG: --logging-format="text"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765547    2531 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765550    2531 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765553    2531 flags.go:64] FLAG: --manifest-url=""
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765555    2531 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765559    2531 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765562    2531 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765566    2531 flags.go:64] FLAG: --max-pods="110"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765569    2531 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765571    2531 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765574    2531 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765577    2531 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765580    2531 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765582    2531 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 19:29:50.773424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765585    2531 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765592    2531 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765595    2531 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765598    2531 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765601    2531 flags.go:64] FLAG: --pod-cidr=""
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765604    2531 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765610    2531 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765613    2531 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765616    2531 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765619    2531 flags.go:64] FLAG: --port="10250"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765622    2531 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765624    2531 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d4ee7ec47d0723bc"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765628    2531 flags.go:64] FLAG: --qos-reserved=""
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765630    2531 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765633    2531 flags.go:64] FLAG: --register-node="true"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765636    2531 flags.go:64] FLAG: --register-with-taints=""
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765639    2531 flags.go:64] FLAG: --registry-burst="10"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765642    2531 flags.go:64] FLAG: --registry-qps="5"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765644    2531 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765647    2531 flags.go:64] FLAG: --reserved-memory=""
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765650    2531 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765653    2531 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765656    2531 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765658    2531 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765661    2531 flags.go:64] FLAG: --runonce="false"
Jul 29 19:29:50.774520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765663    2531 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765666    2531 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765669    2531 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765671    2531 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765674    2531 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765677    2531 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765680    2531 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765683    2531 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765685    2531 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765688    2531 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765691    2531 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765693    2531 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765696    2531 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765700    2531 flags.go:64] FLAG: --system-cgroups=""
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765702    2531 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765707    2531 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765710    2531 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765712    2531 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765716    2531 flags.go:64] FLAG: --tls-min-version=""
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765719    2531 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765725    2531 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765728    2531 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765730    2531 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765733    2531 flags.go:64] FLAG: --v="2"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765737    2531 flags.go:64] FLAG: --version="false"
Jul 29 19:29:50.775461 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765741    2531 flags.go:64] FLAG: --vmodule=""
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765744    2531 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.765747    2531 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765858    2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765862    2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765865    2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765867    2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765871    2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765873    2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765875    2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765878    2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765880    2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765882    2531 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765885    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765888    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765890    2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765894    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765896    2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765899    2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765901    2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:29:50.776081 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765904    2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765912    2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765914    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765917    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765919    2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765922    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765925    2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765928    2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765931    2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765933    2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765936    2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765938    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765941    2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765943    2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765946    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765948    2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765950    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765953    2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765955    2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:29:50.776859 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765958    2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765960    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765962    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765965    2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765967    2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765969    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765972    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765974    2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765977    2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765980    2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765983    2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765985    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765987    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765990    2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765992    2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765995    2531 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.765997    2531 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766000    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766002    2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766004    2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:29:50.777643 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766008    2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766011    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766013    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766016    2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766018    2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766021    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766023    2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766027    2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766031    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766033    2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766036    2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766039    2531 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766041    2531 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766044    2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766046    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766048    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766051    2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766053    2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766055    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:29:50.778215 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766058    2531 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766060    2531 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766064    2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766066    2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766069    2531 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766071    2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766073    2531 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766076    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766078    2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766081    2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766084    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766088    2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766091    2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766095    2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766098    2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766100    2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766103    2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766107    2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766110    2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:29:50.778768 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766113    2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766116    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766118    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766120    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.766123    2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.766131    2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.773397    2531 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.773417    2531 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.773442    2531 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.773450    2531 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773532    2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773540    2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773547    2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773553    2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:29:50.779304 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773558    2531 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773565    2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773570    2531 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773575    2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773580    2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773584    2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773589    2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773593    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773599    2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773605    2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773610    2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773615    2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773619    2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773623    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773627    2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773632    2531 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773636    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773640    2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773644    2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:29:50.779708 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773648    2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773653    2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773657    2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773661    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773666    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773670    2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773676    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773681    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773685    2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773689    2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773694    2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773698    2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773702    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773706    2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773710    2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773714    2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773718    2531 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773722    2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773726    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773730    2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:29:50.780258 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773734    2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773738    2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773742    2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773746    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773751    2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773755    2531 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773760    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773764    2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773768    2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773772    2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773776    2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773780    2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773784    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773788    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773792    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773797    2531 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773801    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773806    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773812    2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773817    2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:29:50.780775 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773821    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773825    2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773829    2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773833    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773837    2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773842    2531 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773846    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773850    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773855    2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773859    2531 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773863    2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773868    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773872    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773876    2531 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773880    2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773884    2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773888    2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773915    2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773922    2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773928    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:29:50.781316 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773932    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773937    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773941    2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773945    2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773950    2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773954    2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773958    2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773963    2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773968    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773972    2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773977    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773981    2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773986    2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773990    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773994    2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:29:50.782048 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.773998    2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.774007    2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774186    2531 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774195    2531 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774199    2531 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774204    2531 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774208    2531 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774213    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774217    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774222    2531 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774246    2531 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774251    2531 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774257    2531 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774261    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774265    2531 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 19:29:50.782536 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774269    2531 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774274    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774278    2531 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774282    2531 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774287    2531 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774291    2531 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774295    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774299    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774304    2531 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774308    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774312    2531 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774316    2531 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774321    2531 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774325    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774332    2531 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774338    2531 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774344    2531 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774349    2531 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774353    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 19:29:50.783102 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774358    2531 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774362    2531 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774367    2531 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774372    2531 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774376    2531 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774380    2531 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774384    2531 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774388    2531 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774394    2531 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774401    2531 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774406    2531 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774410    2531 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774414    2531 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774418    2531 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774422    2531 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774427    2531 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774433    2531 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774438    2531 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774443    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 19:29:50.783840 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774448    2531 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774452    2531 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774456    2531 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774460    2531 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774465    2531 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774469    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774473    2531 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774477    2531 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774481    2531 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774485    2531 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774491    2531 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774495    2531 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774499    2531 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774503    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774508    2531 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774512    2531 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774516    2531 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774520    2531 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774524    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774527    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 19:29:50.784328 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774531    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774535    2531 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774539    2531 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774543    2531 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774547    2531 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774551    2531 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774555    2531 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774559    2531 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774563    2531 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774568    2531 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774572    2531 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774576    2531 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774580    2531 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774584    2531 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774588    2531 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774592    2531 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774596    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774599    2531 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774604    2531 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774608    2531 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 19:29:50.784808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774612    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774617    2531 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774621    2531 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774626    2531 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774630    2531 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774634    2531 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774638    2531 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:50.774643    2531 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.774651    2531 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.774808    2531 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.778123    2531 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.779325    2531 server.go:1019] "Starting client certificate rotation"
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.779426    2531 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:29:50.785305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.780089    2531 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 19:29:50.785625 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.782689    2531 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:29:50.785625 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.784509    2531 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 19:29:50.794705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.794689    2531 log.go:25] "Validated CRI v1 runtime API"
Jul 29 19:29:50.798222 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.798205    2531 log.go:25] "Validated CRI v1 image API"
Jul 29 19:29:50.799744 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.799726    2531 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 19:29:50.802118 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.802088    2531 fs.go:135] Filesystem UUIDs: map[709a0d92-d077-41b9-a49b-bcb324328feb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e9614373-6de7-464f-94ca-2446667eb914:/dev/nvme0n1p3]
Jul 29 19:29:50.802196 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.802117    2531 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 19:29:50.807338 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.807210    2531 manager.go:216] Machine: {Timestamp:2026-07-29 19:29:50.805882975 +0000 UTC m=+0.307964973 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099978 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2590852a6e05cf1796edc94b8c4189 SystemUUID:ec259085-2a6e-05cf-1796-edc94b8c4189 BootID:f96ebf66-edd5-4517-be8f-733a6beb431d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:c9:3c:e2:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:c9:3c:e2:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:ab:a0:e8:b4:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 19:29:50.807338 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.807331    2531 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 19:29:50.807502 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.807434    2531 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 19:29:50.810659 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.810633    2531 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 19:29:50.810790 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.810663    2531 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 19:29:50.811843 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.811833    2531 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 19:29:50.811875 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.811846    2531 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 19:29:50.811875 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.811853    2531 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:29:50.812245 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.812216    2531 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:29:50.812402 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.812390    2531 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 19:29:50.813091 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.813082    2531 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 19:29:50.815700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.815689    2531 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:29:50.815810 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.815801    2531 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 19:29:50.815849 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.815829    2531 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 19:29:50.815849 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.815839    2531 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 19:29:50.815924 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.815853    2531 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 19:29:50.815924 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.815862    2531 kubelet.go:398] "Adding apiserver pod source"
Jul 29 19:29:50.815924 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.815870    2531 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 19:29:50.816207 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.816196    2531 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:29:50.816263 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.816215    2531 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 19:29:50.818469 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.818449    2531 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 19:29:50.820243 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.820218    2531 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 19:29:50.820301 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.820264    2531 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 19:29:50.822321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822302    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822328    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822339    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822348    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822368    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822375    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822384    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822391    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822399    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 19:29:50.822420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822406    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 19:29:50.822692 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822433    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 19:29:50.822692 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.822440    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 19:29:50.823812 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.823796    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 19:29:50.823870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.823825    2531 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 19:29:50.827066 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.827041    2531 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 19:29:50.827132 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.827054    2531 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 19:29:50.827132 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.827093    2531 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 19:29:50.827290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.827277    2531 server.go:1268] "Started kubelet"
Jul 29 19:29:50.827400 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.827375    2531 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 19:29:50.827531 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.827491    2531 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 19:29:50.827904 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.827883    2531 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 19:29:50.828185 ip-10-0-131-41 systemd[1]: Started Kubernetes Kubelet.
Jul 29 19:29:50.829402 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.829362    2531 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 19:29:50.829632 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.829590    2531 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 19:29:50.831908 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.831887    2531 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 19:29:50.833036 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.831959    2531 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-41.ec2.internal.18c6d97322cbbcb9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-41.ec2.internal,UID:ip-10-0-131-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-41.ec2.internal,},FirstTimestamp:2026-07-29 19:29:50.827224249 +0000 UTC m=+0.329306247,LastTimestamp:2026-07-29 19:29:50.827224249 +0000 UTC m=+0.329306247,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-41.ec2.internal,}"
Jul 29 19:29:50.835287 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.835251    2531 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 19:29:50.835287 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.835261    2531 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 19:29:50.835533 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.835517    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:50.835909 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.835894    2531 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 19:29:50.835909 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.835894    2531 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 19:29:50.836041 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.835933    2531 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 19:29:50.836041 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836022    2531 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 19:29:50.836041 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836030    2531 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 19:29:50.836360 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836346    2531 factory.go:153] Registering CRI-O factory
Jul 29 19:29:50.836418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836364    2531 factory.go:223] Registration of the crio container factory successfully
Jul 29 19:29:50.836418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836411    2531 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 19:29:50.836418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836420    2531 factory.go:55] Registering systemd factory
Jul 29 19:29:50.836547 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836425    2531 factory.go:223] Registration of the systemd container factory successfully
Jul 29 19:29:50.836547 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836441    2531 factory.go:103] Registering Raw factory
Jul 29 19:29:50.836547 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.836454    2531 manager.go:1196] Started watching for new ooms in manager
Jul 29 19:29:50.837077 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.837053    2531 manager.go:349] Starting recovery of all containers
Jul 29 19:29:50.837452 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.837429    2531 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 19:29:50.837570 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.837546    2531 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 19:29:50.853175 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.853017    2531 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7x455"
Jul 29 19:29:50.854555 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.854542    2531 manager.go:354] Recovery completed
Jul 29 19:29:50.857773 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.857757    2531 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7x455"
Jul 29 19:29:50.860103 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.860090    2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:29:50.861801 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.861785    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:29:50.861870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.861817    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:29:50.861870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.861833    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:29:50.862394 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.862375    2531 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 19:29:50.862394 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.862392    2531 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 19:29:50.862493 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.862411    2531 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 19:29:50.862493 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.862422    2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:29:50.863068 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.863055    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:29:50.863110 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.863081    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:29:50.863110 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.863092    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:29:50.864791 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.864780    2531 policy_none.go:49] "None policy: Start"
Jul 29 19:29:50.864833 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.864804    2531 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 19:29:50.864833 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.864815    2531 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 19:29:50.866775 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.866765    2531 policy_none.go:47] "Start"
Jul 29 19:29:50.906759 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.906740    2531 manager.go:337] "Starting Device Plugin manager"
Jul 29 19:29:50.906823 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.906793    2531 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 19:29:50.906823 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.906803    2531 server.go:87] "Starting device plugin registration server"
Jul 29 19:29:50.907036 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.907025    2531 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 19:29:50.907069 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.907037    2531 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 19:29:50.907155 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.907140    2531 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 19:29:50.907224 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.907209    2531 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 19:29:50.907224 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:50.907217    2531 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 19:29:50.907762 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.907741    2531 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 19:29:50.907846 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:50.907786    2531 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.007660 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.007586    2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:29:51.009700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.008538    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:29:51.009700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.008567    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:29:51.009700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.008578    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:29:51.009700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.008610    2531 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.016572 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.016543    2531 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 19:29:51.017261 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.017225    2531 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.017351 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.017275    2531 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-41.ec2.internal\": node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.017929 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.017907    2531 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 19:29:51.018002 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.017949    2531 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 19:29:51.018002 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.017968    2531 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 19:29:51.018103 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.018004    2531 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 19:29:51.019640 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.019624    2531 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:29:51.050382 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.050360    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.118936 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.118897    2531 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal"]
Jul 29 19:29:51.119062 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.119003    2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:29:51.119975 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.119958    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:29:51.120039 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.119991    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:29:51.120039 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.120014    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:29:51.122457 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.122439    2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:29:51.122568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.122552    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.122608 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.122594    2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:29:51.123215 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.123189    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:29:51.123215 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.123197    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:29:51.123215 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.123217    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:29:51.123451 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.123222    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:29:51.123451 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.123248    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:29:51.123451 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.123252    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:29:51.125539 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.125524    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.125646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.125555    2531 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 19:29:51.132659 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.132642    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 19:29:51.132746 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.132674    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 19:29:51.132746 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.132688    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeHasSufficientPID"
Jul 29 19:29:51.136768 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.136750    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba4a8a009e36bddc26b32b1452a78cc0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal\" (UID: \"ba4a8a009e36bddc26b32b1452a78cc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.136854 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.136779    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4a8a009e36bddc26b32b1452a78cc0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal\" (UID: \"ba4a8a009e36bddc26b32b1452a78cc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.136854 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.136801    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/462cce6739494a25cb79bf723aa5b093-config\") pod \"kube-apiserver-proxy-ip-10-0-131-41.ec2.internal\" (UID: \"462cce6739494a25cb79bf723aa5b093\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.141790 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.141775    2531 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-41.ec2.internal\" not found" node="ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.147669 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.147653    2531 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-41.ec2.internal\" not found" node="ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.150687 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.150673    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.237830 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.237805    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba4a8a009e36bddc26b32b1452a78cc0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal\" (UID: \"ba4a8a009e36bddc26b32b1452a78cc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.237830 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.237833    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4a8a009e36bddc26b32b1452a78cc0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal\" (UID: \"ba4a8a009e36bddc26b32b1452a78cc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.238020 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.237850    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/462cce6739494a25cb79bf723aa5b093-config\") pod \"kube-apiserver-proxy-ip-10-0-131-41.ec2.internal\" (UID: \"462cce6739494a25cb79bf723aa5b093\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.238020 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.237893    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/462cce6739494a25cb79bf723aa5b093-config\") pod \"kube-apiserver-proxy-ip-10-0-131-41.ec2.internal\" (UID: \"462cce6739494a25cb79bf723aa5b093\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.238020 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.237921    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba4a8a009e36bddc26b32b1452a78cc0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal\" (UID: \"ba4a8a009e36bddc26b32b1452a78cc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.238020 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.237921    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba4a8a009e36bddc26b32b1452a78cc0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal\" (UID: \"ba4a8a009e36bddc26b32b1452a78cc0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.251373 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.251341    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.352143 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.352120    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.444658 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.444625    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.450546 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.450528    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:51.452665 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.452649    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.553574 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.553540    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.654168 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.654096    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.754584 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.754555    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.778739 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.778703    2531 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 19:29:51.779296 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.778875    2531 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 19:29:51.855436 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.855408    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.863595 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.863553    2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 19:24:52 +0000 UTC" deadline="2028-02-13 21:23:39.175123182 +0000 UTC"
Jul 29 19:29:51.863595 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.863593    2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13537h53m47.311535104s"
Jul 29 19:29:51.956303 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:51.956214    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:51.992155 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:51.992126    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4a8a009e36bddc26b32b1452a78cc0.slice/crio-75dffd6b75bbf191eaafdeda3c7b0cf1009f2f64c8295d29434d8a285d97238c WatchSource:0}: Error finding container 75dffd6b75bbf191eaafdeda3c7b0cf1009f2f64c8295d29434d8a285d97238c: Status 404 returned error can't find the container with id 75dffd6b75bbf191eaafdeda3c7b0cf1009f2f64c8295d29434d8a285d97238c
Jul 29 19:29:51.996582 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:51.996563    2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:29:52.021593 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.021554    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal" event={"ID":"ba4a8a009e36bddc26b32b1452a78cc0","Type":"ContainerStarted","Data":"75dffd6b75bbf191eaafdeda3c7b0cf1009f2f64c8295d29434d8a285d97238c"}
Jul 29 19:29:52.043421 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.043398    2531 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:29:52.056462 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:52.056437    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:52.131819 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.131800    2531 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:29:52.157192 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:52.157170    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:52.229103 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:52.229079    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462cce6739494a25cb79bf723aa5b093.slice/crio-54c29df2c0a75266d04a1b6a5993ae4e225797b4cae0894cecefe222ea946988 WatchSource:0}: Error finding container 54c29df2c0a75266d04a1b6a5993ae4e225797b4cae0894cecefe222ea946988: Status 404 returned error can't find the container with id 54c29df2c0a75266d04a1b6a5993ae4e225797b4cae0894cecefe222ea946988
Jul 29 19:29:52.257774 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:52.257747    2531 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-41.ec2.internal\" not found"
Jul 29 19:29:52.280854 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.279506    2531 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:29:52.335781 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.335744    2531 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:52.352619 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.352596    2531 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:29:52.353864 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.353851    2531 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal"
Jul 29 19:29:52.361264 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:52.361225    2531 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 19:29:53.952061 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:53.952029    2531 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 19:29:54.165712 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.165676    2531 apiserver.go:52] "Watching apiserver"
Jul 29 19:29:54.173455 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.173430    2531 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 19:29:54.173989 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.173965    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-kcnps","kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pt4rd","openshift-image-registry/node-ca-vvxnr","openshift-multus/multus-7v7sj","openshift-multus/multus-additional-cni-plugins-5pw5s","openshift-network-operator/iptables-alerter-lz9xr","openshift-ovn-kubernetes/ovnkube-node-r85vg","kube-system/global-pull-secret-syncer-rhc8g","kube-system/konnectivity-agent-qczjm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td","openshift-dns/node-resolver-zw6kc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal","openshift-multus/network-metrics-daemon-ljf4v"]
Jul 29 19:29:54.178709 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.176615    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.180424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.178859    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.180424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.179034    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-66bzf\""
Jul 29 19:29:54.180424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.179452    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 19:29:54.180424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.179475    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:29:54.180424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.179453    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 19:29:54.182417 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.182394    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 19:29:54.182738 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.182719    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 19:29:54.182881 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.182863    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 19:29:54.184384 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.183042    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tkshp\""
Jul 29 19:29:54.184384 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.183512    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.184384 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.183874    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.184384 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.184331    2531 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 19:29:54.186077 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.185969    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 19:29:54.186209 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.186159    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:29:54.186483 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.186459    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.186483 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.186482    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8qhs8\""
Jul 29 19:29:54.186701 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.186685    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 19:29:54.186923 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.186905    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2fkcr\""
Jul 29 19:29:54.187815 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.187632    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 19:29:54.187815 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.187642    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 19:29:54.188991 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.188973    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.190302 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.190178    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 19:29:54.190302 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.190192    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 19:29:54.190302 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.190203    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 19:29:54.190302 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.190253    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 19:29:54.190302 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.190210    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5qmkt\""
Jul 29 19:29:54.191627 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.191609    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8r684\""
Jul 29 19:29:54.191808 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.191795    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 19:29:54.192013 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.191998    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 19:29:54.192247 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.192232    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.192349 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.192303    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:29:54.193788 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.193771    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:54.193875 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.193840    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:29:54.194167 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194149    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chcjx\" (UniqueName: \"kubernetes.io/projected/b7698166-8d87-442d-b614-4ee0e8b543df-kube-api-access-chcjx\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.194244 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194188    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-tuned\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194244 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194207    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-cni-bin\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194244 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194222    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwn8l\" (UniqueName: \"kubernetes.io/projected/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-kube-api-access-vwn8l\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194244 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194237    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7698166-8d87-442d-b614-4ee0e8b543df-host-slash\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194251    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194278    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-socket-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194295    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-registration-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194309    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-var-lib-kubelet\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194324    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-system-cni-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194338    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-cni-multus\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194358    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-kubelet\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194379    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-multus-certs\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194400    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-sys-fs\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.194439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194414    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysconfig\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194435    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-systemd\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194461    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-serviceca\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194477    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-os-release\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194492    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-k8s-cni-cncf-io\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194510    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-hostroot\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194531    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-device-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194549    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-etc-selinux\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194572    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgz7d\" (UniqueName: \"kubernetes.io/projected/b47cf918-4b85-433b-98ba-8c227c2d4ff8-kube-api-access-qgz7d\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194586    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-host\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194598    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-cni-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194612    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-daemon-config\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194626    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7698166-8d87-442d-b614-4ee0e8b543df-iptables-alerter-script\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194638    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-sys\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194651    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-lib-modules\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194664    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-host\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194686    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xm58\" (UniqueName: \"kubernetes.io/projected/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-kube-api-access-8xm58\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.194919 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194703    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-modprobe-d\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194723    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysctl-d\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194758    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysctl-conf\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194781    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-run\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194795    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-tmp\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194808    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-etc-kubernetes\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194826    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-cnibin\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194840    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-cni-binary-copy\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194861    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-conf-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194881    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-kubernetes\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194896    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgf6m\" (UniqueName: \"kubernetes.io/projected/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-kube-api-access-lgf6m\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194910    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-socket-dir-parent\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.195705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.194925    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-netns\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.196364 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.196345    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.197867 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.197841    2531 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 19:29:54.199157 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.199138    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.199361 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.199337    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 19:29:54.203607 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.203520    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.203856 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.203815    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:54.203941 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.203885    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:29:54.205278 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.205254    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 19:29:54.205662 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.205645    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 19:29:54.205907 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.205891    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6vj82\""
Jul 29 19:29:54.207590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.206164    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 19:29:54.207590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.206526    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 19:29:54.207590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.206746    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 19:29:54.207590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.206965    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 19:29:54.207590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.207225    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 19:29:54.207818 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.207697    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r7nhj\""
Jul 29 19:29:54.211870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.211602    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 19:29:54.211870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.211718    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sr9g4\""
Jul 29 19:29:54.211870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.211777    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 19:29:54.220571 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.220554    2531 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hlxdx"
Jul 29 19:29:54.227830 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.227812    2531 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hlxdx"
Jul 29 19:29:54.285553 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.285536    2531 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 19:29:54.295744 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295720    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-var-lib-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.295857 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295761    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgf6m\" (UniqueName: \"kubernetes.io/projected/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-kube-api-access-lgf6m\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.295857 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295788    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-netns\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.295857 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295820    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-cnibin\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.295857 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295844    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-systemd-units\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295879    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-etc-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295903    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/412d056b-e379-4210-a954-218d50a78c51-ovn-node-metrics-cert\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295928    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwn8l\" (UniqueName: \"kubernetes.io/projected/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-kube-api-access-vwn8l\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295955    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzbg8\" (UniqueName: \"kubernetes.io/projected/a5e00286-0955-436b-bf31-2e3787ce8c46-kube-api-access-qzbg8\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295977    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-run-netns\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.295998    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-cni-netd\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296023    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-system-cni-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.296087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296073    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-sys-fs\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296097    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysconfig\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296121    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-systemd\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296142    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-run\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296164    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4fe53de-2bc3-41e4-b90a-f10105952e63-konnectivity-ca\") pod \"konnectivity-agent-qczjm\" (UID: \"c4fe53de-2bc3-41e4-b90a-f10105952e63\") " pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296190    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-systemd\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296214    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-serviceca\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296249    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-k8s-cni-cncf-io\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296274    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-hostroot\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296298    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-device-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296337    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-etc-selinux\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296368    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgz7d\" (UniqueName: \"kubernetes.io/projected/b47cf918-4b85-433b-98ba-8c227c2d4ff8-kube-api-access-qgz7d\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296390    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-host\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296419    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7698166-8d87-442d-b614-4ee0e8b543df-iptables-alerter-script\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296448    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-lib-modules\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.296488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296473    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xm58\" (UniqueName: \"kubernetes.io/projected/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-kube-api-access-8xm58\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296496    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296521    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296545    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2dx5\" (UniqueName: \"kubernetes.io/projected/fd909c25-730e-4522-93b2-b935f5b80db7-kube-api-access-c2dx5\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296569    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-kubelet\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296591    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-ovn\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296614    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysctl-d\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296638    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysctl-conf\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296665    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-tmp\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296687    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-dbus\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296721    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-system-cni-dir\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296745    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-run-ovn-kubernetes\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296773    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-etc-kubernetes\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296809    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-cnibin\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296833    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-cni-binary-copy\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296857    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296883    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.297190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296909    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-socket-dir-parent\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296934    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e00286-0955-436b-bf31-2e3787ce8c46-tmp-dir\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296958    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-os-release\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.296985    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chcjx\" (UniqueName: \"kubernetes.io/projected/b7698166-8d87-442d-b614-4ee0e8b543df-kube-api-access-chcjx\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297015    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-tuned\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297038    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5e00286-0955-436b-bf31-2e3787ce8c46-hosts-file\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297082    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njzh6\" (UniqueName: \"kubernetes.io/projected/985dc327-84a0-4719-8e62-74000ad36ea5-kube-api-access-njzh6\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297114    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297138    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-env-overrides\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297165    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-cni-bin\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297202    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7698166-8d87-442d-b614-4ee0e8b543df-host-slash\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297228    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297253    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-socket-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297278    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-registration-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297303    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-var-lib-kubelet\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297328    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-kubelet-config\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297352    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.297968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297385    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-cni-multus\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297409    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-kubelet\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297434    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-multus-certs\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297460    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297484    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-log-socket\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297509    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-cni-bin\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297533    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-ovnkube-script-lib\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297568    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-os-release\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297592    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-sys\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297617    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-slash\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297641    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-host\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297673    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-cni-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297700    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-daemon-config\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297725    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-cni-binary-copy\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297751    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-node-log\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297777    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297806    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-ovnkube-config\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.298809 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297834    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxgdh\" (UniqueName: \"kubernetes.io/projected/412d056b-e379-4210-a954-218d50a78c51-kube-api-access-vxgdh\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297860    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-modprobe-d\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297882    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4fe53de-2bc3-41e4-b90a-f10105952e63-agent-certs\") pod \"konnectivity-agent-qczjm\" (UID: \"c4fe53de-2bc3-41e4-b90a-f10105952e63\") " pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297900    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-conf-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297916    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-kubernetes\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.297988    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-kubernetes\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.298267    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-netns\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.298628    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-system-cni-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.298683    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-sys-fs\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.298734    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysconfig\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.298778    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-systemd\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.298835    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-run\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.299266    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-serviceca\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.299324    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-k8s-cni-cncf-io\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.299368    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-hostroot\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.299426    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-device-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.299650 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.299524    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-etc-selinux\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.300422 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.299779    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-host\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.300422 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.300293    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7698166-8d87-442d-b614-4ee0e8b543df-iptables-alerter-script\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.300521 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.300440    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-lib-modules\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.300790 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.300762    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-registration-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.300874 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.300785    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-var-lib-kubelet\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.300926    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysctl-conf\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301011    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-cni-multus\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301069    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-kubelet\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301069    2531 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301129    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-run-multus-certs\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301229    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-os-release\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301275    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-sys\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301324    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-host\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.301579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301388    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-cni-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.301972 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301887    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-daemon-config\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.302023 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.301985    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-etc-kubernetes\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.302188 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302036    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-modprobe-d\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.302188 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302082    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-cnibin\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.302188 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302119    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-conf-dir\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.302392 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302232    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-sysctl-d\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.302392 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302314    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-multus-socket-dir-parent\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.302705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302546    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-cni-binary-copy\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.302705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302640    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.302705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302651    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-host-var-lib-cni-bin\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.302705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302673    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7698166-8d87-442d-b614-4ee0e8b543df-host-slash\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.302996 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.302757    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b47cf918-4b85-433b-98ba-8c227c2d4ff8-socket-dir\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.304762 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.304708    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-tmp\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.305011 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.304992    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-etc-tuned\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.315047 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.314985    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwn8l\" (UniqueName: \"kubernetes.io/projected/18dd8d9d-1680-4dd7-8215-d78e2d86f88d-kube-api-access-vwn8l\") pod \"multus-7v7sj\" (UID: \"18dd8d9d-1680-4dd7-8215-d78e2d86f88d\") " pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.315636 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.315611    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgz7d\" (UniqueName: \"kubernetes.io/projected/b47cf918-4b85-433b-98ba-8c227c2d4ff8-kube-api-access-qgz7d\") pod \"aws-ebs-csi-driver-node-cd9td\" (UID: \"b47cf918-4b85-433b-98ba-8c227c2d4ff8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.316136 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.316117    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chcjx\" (UniqueName: \"kubernetes.io/projected/b7698166-8d87-442d-b614-4ee0e8b543df-kube-api-access-chcjx\") pod \"iptables-alerter-lz9xr\" (UID: \"b7698166-8d87-442d-b614-4ee0e8b543df\") " pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.316577 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.316558    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xm58\" (UniqueName: \"kubernetes.io/projected/e91b0174-e1a5-4f39-9d6c-e02d706dfffa-kube-api-access-8xm58\") pod \"tuned-pt4rd\" (UID: \"e91b0174-e1a5-4f39-9d6c-e02d706dfffa\") " pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.323530 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.323505    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgf6m\" (UniqueName: \"kubernetes.io/projected/5bdc4868-d5c0-4f51-a622-2d53db99bdaf-kube-api-access-lgf6m\") pod \"node-ca-vvxnr\" (UID: \"5bdc4868-d5c0-4f51-a622-2d53db99bdaf\") " pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.371539 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.371501    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal" event={"ID":"462cce6739494a25cb79bf723aa5b093","Type":"ContainerStarted","Data":"54c29df2c0a75266d04a1b6a5993ae4e225797b4cae0894cecefe222ea946988"}
Jul 29 19:29:54.398766 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398728    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-kubelet-config\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.398766 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398766    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398788    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398810    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-log-socket\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398832    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-cni-bin\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398855    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-ovnkube-script-lib\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398856    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-kubelet-config\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398877    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-log-socket\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398894    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-cni-bin\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398910    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-slash\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398865    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398878    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-slash\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.398948 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.398924    2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.398986    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-cni-binary-copy\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.399012    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret podName:0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:54.898990157 +0000 UTC m=+3.053248773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret") pod "global-pull-secret-syncer-rhc8g" (UID: "0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399040    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-node-log\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399165    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399181    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-ovnkube-config\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399196    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxgdh\" (UniqueName: \"kubernetes.io/projected/412d056b-e379-4210-a954-218d50a78c51-kube-api-access-vxgdh\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399212    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4fe53de-2bc3-41e4-b90a-f10105952e63-agent-certs\") pod \"konnectivity-agent-qczjm\" (UID: \"c4fe53de-2bc3-41e4-b90a-f10105952e63\") " pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399228    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-var-lib-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399247    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-cnibin\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399273    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-systemd-units\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399288    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-etc-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399312    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/412d056b-e379-4210-a954-218d50a78c51-ovn-node-metrics-cert\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399328    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzbg8\" (UniqueName: \"kubernetes.io/projected/a5e00286-0955-436b-bf31-2e3787ce8c46-kube-api-access-qzbg8\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399342    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-run-netns\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399357    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-cni-netd\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399375    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4fe53de-2bc3-41e4-b90a-f10105952e63-konnectivity-ca\") pod \"konnectivity-agent-qczjm\" (UID: \"c4fe53de-2bc3-41e4-b90a-f10105952e63\") " pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399377    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-ovnkube-script-lib\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399389    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-systemd\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399426    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399433    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-cni-binary-copy\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399445    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399469    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2dx5\" (UniqueName: \"kubernetes.io/projected/fd909c25-730e-4522-93b2-b935f5b80db7-kube-api-access-c2dx5\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399484    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-systemd-units\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399428    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-systemd\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399511    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-kubelet\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.399568    2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399579    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-etc-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.399646 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.399598    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs podName:985dc327-84a0-4719-8e62-74000ad36ea5 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:54.899588582 +0000 UTC m=+3.053847178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs") pod "network-metrics-daemon-ljf4v" (UID: "985dc327-84a0-4719-8e62-74000ad36ea5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:54.400107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399745    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-run-netns\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.400107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399771    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-cni-netd\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.400107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399811    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.400107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399854    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.400107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399996    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-cnibin\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.400107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.400031    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-var-lib-openvswitch\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.400107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.399486    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-kubelet\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.410395 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.400157    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-node-log\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.410592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.410557    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4fe53de-2bc3-41e4-b90a-f10105952e63-konnectivity-ca\") pod \"konnectivity-agent-qczjm\" (UID: \"c4fe53de-2bc3-41e4-b90a-f10105952e63\") " pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.411254 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411234    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-ovn\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.411337 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411285    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-dbus\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.411337 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411311    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-system-cni-dir\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.411417 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411345    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-run-ovn-kubernetes\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.411417 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411380    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.411480 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411411    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.411480 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411446    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e00286-0955-436b-bf31-2e3787ce8c46-tmp-dir\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.411480 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411471    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-os-release\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.411566 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411480    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-ovnkube-config\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.411566 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411502    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5e00286-0955-436b-bf31-2e3787ce8c46-hosts-file\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.411566 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411533    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njzh6\" (UniqueName: \"kubernetes.io/projected/985dc327-84a0-4719-8e62-74000ad36ea5-kube-api-access-njzh6\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:54.411566 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411552    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/412d056b-e379-4210-a954-218d50a78c51-ovn-node-metrics-cert\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.411679 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411564    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:54.411679 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411591    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-env-overrides\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.411739 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411693    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-run-ovn\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.411854 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411837    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-dbus\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.411916 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411901    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4fe53de-2bc3-41e4-b90a-f10105952e63-agent-certs\") pod \"konnectivity-agent-qczjm\" (UID: \"c4fe53de-2bc3-41e4-b90a-f10105952e63\") " pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.411951 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411902    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-system-cni-dir\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.411951 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.411934    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/412d056b-e379-4210-a954-218d50a78c51-host-run-ovn-kubernetes\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.412111 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.412095    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a5e00286-0955-436b-bf31-2e3787ce8c46-hosts-file\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.412292 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.412241    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-os-release\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.412423 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.412405    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5e00286-0955-436b-bf31-2e3787ce8c46-tmp-dir\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.412423 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.412417    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd909c25-730e-4522-93b2-b935f5b80db7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.412842 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.412817    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/412d056b-e379-4210-a954-218d50a78c51-env-overrides\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.412935 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.412869    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd909c25-730e-4522-93b2-b935f5b80db7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.415160 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.415139    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzbg8\" (UniqueName: \"kubernetes.io/projected/a5e00286-0955-436b-bf31-2e3787ce8c46-kube-api-access-qzbg8\") pod \"node-resolver-zw6kc\" (UID: \"a5e00286-0955-436b-bf31-2e3787ce8c46\") " pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.415552 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.415521    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2dx5\" (UniqueName: \"kubernetes.io/projected/fd909c25-730e-4522-93b2-b935f5b80db7-kube-api-access-c2dx5\") pod \"multus-additional-cni-plugins-5pw5s\" (UID: \"fd909c25-730e-4522-93b2-b935f5b80db7\") " pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.430510 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.430482    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:29:54.430510 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.430501    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:29:54.430510 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.430514    2531 projected.go:196] Error preparing data for projected volume kube-api-access-9m8hk for pod openshift-network-diagnostics/network-check-target-kcnps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:54.430697 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.430570    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk podName:1b7cb4ae-431a-4570-9244-7f94cf86e0e9 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:54.930557123 +0000 UTC m=+3.084815724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8hk" (UniqueName: "kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk") pod "network-check-target-kcnps" (UID: "1b7cb4ae-431a-4570-9244-7f94cf86e0e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:54.433573 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.433546    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxgdh\" (UniqueName: \"kubernetes.io/projected/412d056b-e379-4210-a954-218d50a78c51-kube-api-access-vxgdh\") pod \"ovnkube-node-r85vg\" (UID: \"412d056b-e379-4210-a954-218d50a78c51\") " pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.434212 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.434192    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njzh6\" (UniqueName: \"kubernetes.io/projected/985dc327-84a0-4719-8e62-74000ad36ea5-kube-api-access-njzh6\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:54.494198 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.494129    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lz9xr"
Jul 29 19:29:54.509094 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.509073    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td"
Jul 29 19:29:54.526284 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.526119    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pt4rd"
Jul 29 19:29:54.531913 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.531895    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvxnr"
Jul 29 19:29:54.540579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.540561    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7v7sj"
Jul 29 19:29:54.548023 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.548007    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5pw5s"
Jul 29 19:29:54.557032 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.557014    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:29:54.567559 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.567541    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:29:54.574128 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.574110    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zw6kc"
Jul 29 19:29:54.914686 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.914603    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:54.914686 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:54.914653    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:54.914892 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.914742    2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:54.914892 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.914764    2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:54.914892 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.914796    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs podName:985dc327-84a0-4719-8e62-74000ad36ea5 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:55.914782855 +0000 UTC m=+4.069041452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs") pod "network-metrics-daemon-ljf4v" (UID: "985dc327-84a0-4719-8e62-74000ad36ea5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:54.914892 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:54.914825    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret podName:0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:55.914807291 +0000 UTC m=+4.069065904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret") pod "global-pull-secret-syncer-rhc8g" (UID: "0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:55.015788 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.015751    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:55.015975 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.015931    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:29:55.015975 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.015958    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:29:55.015975 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.015968    2531 projected.go:196] Error preparing data for projected volume kube-api-access-9m8hk for pod openshift-network-diagnostics/network-check-target-kcnps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:55.016155 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.016023    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk podName:1b7cb4ae-431a-4570-9244-7f94cf86e0e9 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:56.016005291 +0000 UTC m=+4.170263890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8hk" (UniqueName: "kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk") pod "network-check-target-kcnps" (UID: "1b7cb4ae-431a-4570-9244-7f94cf86e0e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:55.216825 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:55.216789    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bdc4868_d5c0_4f51_a622_2d53db99bdaf.slice/crio-c4be01ae68d399121b44546cf94384d73843ae605993025e5e1ba82db8a91e5c WatchSource:0}: Error finding container c4be01ae68d399121b44546cf94384d73843ae605993025e5e1ba82db8a91e5c: Status 404 returned error can't find the container with id c4be01ae68d399121b44546cf94384d73843ae605993025e5e1ba82db8a91e5c
Jul 29 19:29:55.230817 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.230788    2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:24:54 +0000 UTC" deadline="2028-01-19 23:11:40.5575931 +0000 UTC"
Jul 29 19:29:55.230817 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.230815    2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12939h41m45.326782163s"
Jul 29 19:29:55.239633 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:55.239612    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91b0174_e1a5_4f39_9d6c_e02d706dfffa.slice/crio-2c19eadd64984f186472ad90f2edc16ce9a4fd6b5694dbe5ab321921b6920132 WatchSource:0}: Error finding container 2c19eadd64984f186472ad90f2edc16ce9a4fd6b5694dbe5ab321921b6920132: Status 404 returned error can't find the container with id 2c19eadd64984f186472ad90f2edc16ce9a4fd6b5694dbe5ab321921b6920132
Jul 29 19:29:55.243960 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:55.243936    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd909c25_730e_4522_93b2_b935f5b80db7.slice/crio-3292960a949b1f239e427b25e84e1ffd860545e1676e40efb0e7db934e7bdfa1 WatchSource:0}: Error finding container 3292960a949b1f239e427b25e84e1ffd860545e1676e40efb0e7db934e7bdfa1: Status 404 returned error can't find the container with id 3292960a949b1f239e427b25e84e1ffd860545e1676e40efb0e7db934e7bdfa1
Jul 29 19:29:55.244573 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:55.244550    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dd8d9d_1680_4dd7_8215_d78e2d86f88d.slice/crio-05ca6fc21a69370bc700521e906580ca665fcd35aa8d647523bf4bafcfccea51 WatchSource:0}: Error finding container 05ca6fc21a69370bc700521e906580ca665fcd35aa8d647523bf4bafcfccea51: Status 404 returned error can't find the container with id 05ca6fc21a69370bc700521e906580ca665fcd35aa8d647523bf4bafcfccea51
Jul 29 19:29:55.246087 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:55.245929    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412d056b_e379_4210_a954_218d50a78c51.slice/crio-f3c2846760eacacb2420b0225d02123e06ef60ad5887094b349de2b8a3df1542 WatchSource:0}: Error finding container f3c2846760eacacb2420b0225d02123e06ef60ad5887094b349de2b8a3df1542: Status 404 returned error can't find the container with id f3c2846760eacacb2420b0225d02123e06ef60ad5887094b349de2b8a3df1542
Jul 29 19:29:55.247122 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:55.247103    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47cf918_4b85_433b_98ba_8c227c2d4ff8.slice/crio-ca273429a9d87c458d69f5e8f9b120831d914151c4cafe92e49474a08b9aea60 WatchSource:0}: Error finding container ca273429a9d87c458d69f5e8f9b120831d914151c4cafe92e49474a08b9aea60: Status 404 returned error can't find the container with id ca273429a9d87c458d69f5e8f9b120831d914151c4cafe92e49474a08b9aea60
Jul 29 19:29:55.250842 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:29:55.250538    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7698166_8d87_442d_b614_4ee0e8b543df.slice/crio-ba9e110149ab14b3972c60ce650a2552c773e17c1e6447ec5b361953314aedbc WatchSource:0}: Error finding container ba9e110149ab14b3972c60ce650a2552c773e17c1e6447ec5b361953314aedbc: Status 404 returned error can't find the container with id ba9e110149ab14b3972c60ce650a2552c773e17c1e6447ec5b361953314aedbc
Jul 29 19:29:55.374762 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.374545    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lz9xr" event={"ID":"b7698166-8d87-442d-b614-4ee0e8b543df","Type":"ContainerStarted","Data":"ba9e110149ab14b3972c60ce650a2552c773e17c1e6447ec5b361953314aedbc"}
Jul 29 19:29:55.375699 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.375664    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td" event={"ID":"b47cf918-4b85-433b-98ba-8c227c2d4ff8","Type":"ContainerStarted","Data":"ca273429a9d87c458d69f5e8f9b120831d914151c4cafe92e49474a08b9aea60"}
Jul 29 19:29:55.376749 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.376724    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"f3c2846760eacacb2420b0225d02123e06ef60ad5887094b349de2b8a3df1542"}
Jul 29 19:29:55.377758 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.377731    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7v7sj" event={"ID":"18dd8d9d-1680-4dd7-8215-d78e2d86f88d","Type":"ContainerStarted","Data":"05ca6fc21a69370bc700521e906580ca665fcd35aa8d647523bf4bafcfccea51"}
Jul 29 19:29:55.379025 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.379005    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerStarted","Data":"3292960a949b1f239e427b25e84e1ffd860545e1676e40efb0e7db934e7bdfa1"}
Jul 29 19:29:55.380069 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.380033    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvxnr" event={"ID":"5bdc4868-d5c0-4f51-a622-2d53db99bdaf","Type":"ContainerStarted","Data":"c4be01ae68d399121b44546cf94384d73843ae605993025e5e1ba82db8a91e5c"}
Jul 29 19:29:55.382163 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.382137    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal" event={"ID":"462cce6739494a25cb79bf723aa5b093","Type":"ContainerStarted","Data":"1922e17d56fc00ffa1534097adb7ed31fbe6c946839eb39dc2ce5213043b3653"}
Jul 29 19:29:55.383364 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.383331    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qczjm" event={"ID":"c4fe53de-2bc3-41e4-b90a-f10105952e63","Type":"ContainerStarted","Data":"18802a22421009e847192c4da453bffebd59ceacf9912a753b5f78e5cfb60e0f"}
Jul 29 19:29:55.384337 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.384309    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zw6kc" event={"ID":"a5e00286-0955-436b-bf31-2e3787ce8c46","Type":"ContainerStarted","Data":"fa0623b6b6a641c7686154369f077c3fa1d9ac68cc49a2e19aebf9afc98caea8"}
Jul 29 19:29:55.385304 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.385288    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pt4rd" event={"ID":"e91b0174-e1a5-4f39-9d6c-e02d706dfffa","Type":"ContainerStarted","Data":"2c19eadd64984f186472ad90f2edc16ce9a4fd6b5694dbe5ab321921b6920132"}
Jul 29 19:29:55.922607 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.922569    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:55.922747 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:55.922651    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:55.922819 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.922787    2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:55.922878 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.922849    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret podName:0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:57.922830367 +0000 UTC m=+6.077088970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret") pod "global-pull-secret-syncer-rhc8g" (UID: "0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:55.923261 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.923239    2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:55.923345 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:55.923298    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs podName:985dc327-84a0-4719-8e62-74000ad36ea5 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:57.923282484 +0000 UTC m=+6.077541101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs") pod "network-metrics-daemon-ljf4v" (UID: "985dc327-84a0-4719-8e62-74000ad36ea5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:56.023989 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.023946    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:56.024180 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:56.024163    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:29:56.024263 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:56.024192    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:29:56.024263 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:56.024205    2531 projected.go:196] Error preparing data for projected volume kube-api-access-9m8hk for pod openshift-network-diagnostics/network-check-target-kcnps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:56.024370 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:56.024262    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk podName:1b7cb4ae-431a-4570-9244-7f94cf86e0e9 nodeName:}" failed. No retries permitted until 2026-07-29 19:29:58.02424387 +0000 UTC m=+6.178502477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8hk" (UniqueName: "kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk") pod "network-check-target-kcnps" (UID: "1b7cb4ae-431a-4570-9244-7f94cf86e0e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:56.231705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.231644    2531 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:24:54 +0000 UTC" deadline="2028-03-10 13:53:39.887332799 +0000 UTC"
Jul 29 19:29:56.231705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.231681    2531 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14154h23m43.655657059s"
Jul 29 19:29:56.368295 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.368255    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:56.368295 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.368295    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:56.368541 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.368255    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:56.368541 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:56.368405    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:29:56.368541 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:56.368517    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:29:56.368693 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:56.368594    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:29:56.397936 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.397897    2531 generic.go:356] "Generic (PLEG): container finished" podID="ba4a8a009e36bddc26b32b1452a78cc0" containerID="343c4e83d1039fd4eef4e8bccef791a2ca00333903ee99480e048ec3a1caefbb" exitCode=0
Jul 29 19:29:56.398870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.398844    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal" event={"ID":"ba4a8a009e36bddc26b32b1452a78cc0","Type":"ContainerDied","Data":"343c4e83d1039fd4eef4e8bccef791a2ca00333903ee99480e048ec3a1caefbb"}
Jul 29 19:29:56.421781 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:56.421713    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-41.ec2.internal" podStartSLOduration=3.421692621 podStartE2EDuration="3.421692621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:29:55.400351731 +0000 UTC m=+3.554610351" watchObservedRunningTime="2026-07-29 19:29:56.421692621 +0000 UTC m=+4.575951242"
Jul 29 19:29:57.425593 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:57.425556    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal" event={"ID":"ba4a8a009e36bddc26b32b1452a78cc0","Type":"ContainerStarted","Data":"8e25169de580e2ceba017536d420876af0d42d3e92ca8caa15e8a67f8eb8a10c"}
Jul 29 19:29:57.943154 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:57.942445    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:57.943154 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:57.942520    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:57.943154 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:57.942646    2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:57.943154 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:57.942700    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret podName:0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:01.942684041 +0000 UTC m=+10.096942653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret") pod "global-pull-secret-syncer-rhc8g" (UID: "0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:29:57.943154 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:57.943077    2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:57.943154 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:57.943123    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs podName:985dc327-84a0-4719-8e62-74000ad36ea5 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:01.943108508 +0000 UTC m=+10.097367111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs") pod "network-metrics-daemon-ljf4v" (UID: "985dc327-84a0-4719-8e62-74000ad36ea5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:29:58.043179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:58.043114    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:58.043366 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:58.043264    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:29:58.043366 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:58.043284    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:29:58.043366 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:58.043307    2531 projected.go:196] Error preparing data for projected volume kube-api-access-9m8hk for pod openshift-network-diagnostics/network-check-target-kcnps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:58.043525 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:58.043371    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk podName:1b7cb4ae-431a-4570-9244-7f94cf86e0e9 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:02.043351315 +0000 UTC m=+10.197609919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8hk" (UniqueName: "kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk") pod "network-check-target-kcnps" (UID: "1b7cb4ae-431a-4570-9244-7f94cf86e0e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:29:58.367866 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:58.367158    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:29:58.367866 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:58.367276    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:29:58.367866 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:58.367644    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:29:58.367866 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:58.367743    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:29:58.368443 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:29:58.368267    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:29:58.368443 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:29:58.368369    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:00.366739 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:00.366701    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:00.367237 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:00.366826    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:00.367237 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:00.366883    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:00.367237 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:00.366960    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:00.367237 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:00.367005    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:00.367237 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:00.367101    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:01.978631 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:01.978595    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:01.979134 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:01.978681    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:01.979134 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:01.978762    2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:30:01.979134 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:01.978805    2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:30:01.979134 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:01.978854    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs podName:985dc327-84a0-4719-8e62-74000ad36ea5 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:09.978833967 +0000 UTC m=+18.133092583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs") pod "network-metrics-daemon-ljf4v" (UID: "985dc327-84a0-4719-8e62-74000ad36ea5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:30:01.979134 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:01.978874    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret podName:0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:09.97886497 +0000 UTC m=+18.133123567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret") pod "global-pull-secret-syncer-rhc8g" (UID: "0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:30:02.080527 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:02.079862    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:02.080527 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:02.080109    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:30:02.080527 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:02.080132    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:30:02.080527 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:02.080145    2531 projected.go:196] Error preparing data for projected volume kube-api-access-9m8hk for pod openshift-network-diagnostics/network-check-target-kcnps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:30:02.080527 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:02.080202    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk podName:1b7cb4ae-431a-4570-9244-7f94cf86e0e9 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:10.080185027 +0000 UTC m=+18.234443646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8hk" (UniqueName: "kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk") pod "network-check-target-kcnps" (UID: "1b7cb4ae-431a-4570-9244-7f94cf86e0e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:30:02.368127 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:02.366259    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:02.368127 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:02.366398    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:02.368127 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:02.366740    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:02.368127 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:02.366832    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:02.368127 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:02.366882    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:02.368127 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:02.366947    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:04.370135 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:04.370041    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:04.370625 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:04.370593    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:04.370736 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:04.370633    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:04.370736 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:04.370723    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:04.370855 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:04.370764    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:04.370855 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:04.370844    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:06.366504 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:06.366411    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:06.366504 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:06.366431    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:06.366504 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:06.366431    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:06.366948 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:06.366542    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:06.366948 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:06.366621    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:06.366948 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:06.366689    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:08.366728 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:08.366681    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:08.367229 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:08.366827    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:08.367305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:08.367238    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:08.367361 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:08.367340    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:08.367488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:08.367461    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:08.367566 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:08.367530    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:10.042269 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:10.042224    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:10.042735 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:10.042310    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:10.042735 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.042410    2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:30:10.042735 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.042432    2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:30:10.042735 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.042490    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs podName:985dc327-84a0-4719-8e62-74000ad36ea5 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:26.042470475 +0000 UTC m=+34.196729076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs") pod "network-metrics-daemon-ljf4v" (UID: "985dc327-84a0-4719-8e62-74000ad36ea5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:30:10.042735 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.042510    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret podName:0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:26.042502011 +0000 UTC m=+34.196760611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret") pod "global-pull-secret-syncer-rhc8g" (UID: "0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:30:10.143615 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:10.143524    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:10.143779 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.143725    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:30:10.143779 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.143750    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:30:10.143779 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.143763    2531 projected.go:196] Error preparing data for projected volume kube-api-access-9m8hk for pod openshift-network-diagnostics/network-check-target-kcnps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:30:10.143948 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.143827    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk podName:1b7cb4ae-431a-4570-9244-7f94cf86e0e9 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:26.143808426 +0000 UTC m=+34.298067038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8hk" (UniqueName: "kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk") pod "network-check-target-kcnps" (UID: "1b7cb4ae-431a-4570-9244-7f94cf86e0e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:30:10.366316 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:10.366236    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:10.366316 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:10.366263    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:10.366519 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:10.366236    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:10.366519 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.366404    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:10.366621 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.366543    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:10.366665 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:10.366618    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:12.366933 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:12.366892    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:12.366933 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:12.366936    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:12.367405 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:12.366996    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:12.367405 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:12.367047    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:12.367405 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:12.367115    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:12.367405 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:12.367222    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:14.366825 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.366528    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:14.367406 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.366544    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:14.367406 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:14.366903    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:14.367406 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:14.367018    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:14.367406 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.366596    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:14.367406 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:14.367133    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:14.460959 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.460929    2531 generic.go:356] "Generic (PLEG): container finished" podID="fd909c25-730e-4522-93b2-b935f5b80db7" containerID="ee7fbab421a14a82c0b089f1c764a21b43f7ad34d2e491f0d2950077af8a2830" exitCode=0
Jul 29 19:30:14.461175 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.461006    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerDied","Data":"ee7fbab421a14a82c0b089f1c764a21b43f7ad34d2e491f0d2950077af8a2830"}
Jul 29 19:30:14.462570 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.462550    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvxnr" event={"ID":"5bdc4868-d5c0-4f51-a622-2d53db99bdaf","Type":"ContainerStarted","Data":"1393ec4ae9299c3d2c087ca4da9d5f7bb44c67a1d60a5049d4d60288579c6ac4"}
Jul 29 19:30:14.464042 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.464020    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qczjm" event={"ID":"c4fe53de-2bc3-41e4-b90a-f10105952e63","Type":"ContainerStarted","Data":"1912ee3b73999b6787d8d001b46d9d3ced72b3808216eea379736388e1a52eec"}
Jul 29 19:30:14.465429 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.465407    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zw6kc" event={"ID":"a5e00286-0955-436b-bf31-2e3787ce8c46","Type":"ContainerStarted","Data":"bd5f394e5f71e3356879e313ea059e75dccab785d1d434320f569c0f8eda627a"}
Jul 29 19:30:14.466855 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.466833    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pt4rd" event={"ID":"e91b0174-e1a5-4f39-9d6c-e02d706dfffa","Type":"ContainerStarted","Data":"3cf9f60133d23708a0d04b91aaf886ed6fb72f25efa4809cbb461441110fcce0"}
Jul 29 19:30:14.471374 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.471355    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td" event={"ID":"b47cf918-4b85-433b-98ba-8c227c2d4ff8","Type":"ContainerStarted","Data":"976f46eab795f1e055d77b1d646f274d8ab63e417b1f077ecf08bad40083d38d"}
Jul 29 19:30:14.474534 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.474507    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"4a0e126f073a2c6146c82183da57348ccc9b767a0dfa36e587a45b5b6443a02b"}
Jul 29 19:30:14.474625 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.474586    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"51a49fb77efe83d7b369bfeab282a617d5c5f9be97eaa95eff4fd7814d40f89b"}
Jul 29 19:30:14.474668 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.474629    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"f596189fe23590323ac68faee07361d92666ff679f8ecf7e6de450d00d60bb3b"}
Jul 29 19:30:14.474724 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.474700    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"361a8d61614c2e12703e9020642249b89f21ccc53c320e04d3eebf821563131c"}
Jul 29 19:30:14.474778 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.474752    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"f1535b656694f0a54a0e9068bfb702f5e340661356070688ffe08a524016ebe8"}
Jul 29 19:30:14.474823 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.474798    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"dd6d756b0a59e33482f527c538a8f964242ce95d41d7369d3b232c9eb142ed76"}
Jul 29 19:30:14.476070 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.476036    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7v7sj" event={"ID":"18dd8d9d-1680-4dd7-8215-d78e2d86f88d","Type":"ContainerStarted","Data":"184d15957530632cb38bf10c730eba08bb45113b78c593105726b87d2f125922"}
Jul 29 19:30:14.497234 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.497194    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-41.ec2.internal" podStartSLOduration=21.497180561 podStartE2EDuration="21.497180561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:29:57.444520657 +0000 UTC m=+5.598779276" watchObservedRunningTime="2026-07-29 19:30:14.497180561 +0000 UTC m=+22.651439176"
Jul 29 19:30:14.516850 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.516794    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vvxnr" podStartSLOduration=3.9112970540000003 podStartE2EDuration="22.516774259s" totalImagesPullingTime="18.605477205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:14.51632548 +0000 UTC m=+22.670584100" watchObservedRunningTime="2026-07-29 19:30:14.516774259 +0000 UTC m=+22.671032879"
Jul 29 19:30:14.534469 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.534421    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7v7sj" podStartSLOduration=3.863296337 podStartE2EDuration="22.534405756s" totalImagesPullingTime="18.671109419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:14.534377625 +0000 UTC m=+22.688636244" watchObservedRunningTime="2026-07-29 19:30:14.534405756 +0000 UTC m=+22.688664372"
Jul 29 19:30:14.552387 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.552326    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qczjm" podStartSLOduration=3.9430348200000003 podStartE2EDuration="22.552310673s" totalImagesPullingTime="18.609275853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:14.551985298 +0000 UTC m=+22.706243917" watchObservedRunningTime="2026-07-29 19:30:14.552310673 +0000 UTC m=+22.706569315"
Jul 29 19:30:14.568321 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.568270    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zw6kc" podStartSLOduration=3.980676139 podStartE2EDuration="22.568255016s" totalImagesPullingTime="18.587578877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:14.567815419 +0000 UTC m=+22.722074037" watchObservedRunningTime="2026-07-29 19:30:14.568255016 +0000 UTC m=+22.722513634"
Jul 29 19:30:14.586769 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:14.586729    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pt4rd" podStartSLOduration=3.963024832 podStartE2EDuration="22.586713709s" totalImagesPullingTime="18.623688877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:14.586433663 +0000 UTC m=+22.740692281" watchObservedRunningTime="2026-07-29 19:30:14.586713709 +0000 UTC m=+22.740972328"
Jul 29 19:30:15.481035 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:15.481005    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lz9xr" event={"ID":"b7698166-8d87-442d-b614-4ee0e8b543df","Type":"ContainerStarted","Data":"50c502db21eebbb212c9f655d0d2c886a2808a8987c1d8bfdb31c60c72735d9e"}
Jul 29 19:30:15.490154 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:15.490122    2531 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 19:30:15.499455 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:15.499216    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lz9xr" podStartSLOduration=9.084489775 podStartE2EDuration="23.499196248s" totalImagesPullingTime="14.414706473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:15.498215844 +0000 UTC m=+23.652474463" watchObservedRunningTime="2026-07-29 19:30:15.499196248 +0000 UTC m=+23.653454868"
Jul 29 19:30:16.266788 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.266681    2531 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T19:30:15.490150457Z","UUID":"925d3f59-4b59-4a0e-883c-0c6543a9fd90","Handler":null,"Name":"","Endpoint":""}
Jul 29 19:30:16.268921 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.268898    2531 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 19:30:16.269041 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.268944    2531 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 19:30:16.296474 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.296442    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:30:16.297073 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.297036    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:30:16.367128 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.367100    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:16.367295 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.367100    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:16.367295 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:16.367230    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:16.367295 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.367100    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:16.367435 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:16.367321    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:16.367435 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:16.367365    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:16.488077 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.487654    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td" event={"ID":"b47cf918-4b85-433b-98ba-8c227c2d4ff8","Type":"ContainerStarted","Data":"6356d2b5542520cefc645a4dc69436f9b677d9c043fff070abea0e1a95a35178"}
Jul 29 19:30:16.488077 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.487919    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:30:16.488837 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:16.488675    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qczjm"
Jul 29 19:30:17.491841 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:17.491804    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td" event={"ID":"b47cf918-4b85-433b-98ba-8c227c2d4ff8","Type":"ContainerStarted","Data":"6814e9fe4afb70baefa74d8adafae745996489729e701d08d1d165413451a8d1"}
Jul 29 19:30:17.495601 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:17.495570    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"513f84a02dfed1e7eee20cb37729d9e3b4dac179f820587657bd40ac165ec36d"}
Jul 29 19:30:17.517111 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:17.517046    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cd9td" podStartSLOduration=4.720385286 podStartE2EDuration="25.517030451s" totalImagesPullingTime="20.796645165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:17.5170123 +0000 UTC m=+25.671270920" watchObservedRunningTime="2026-07-29 19:30:17.517030451 +0000 UTC m=+25.671289067"
Jul 29 19:30:18.366437 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:18.366401    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:18.366437 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:18.366443    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:18.366685 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:18.366409    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:18.366685 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:18.366535    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:18.366685 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:18.366630    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:18.366841 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:18.366706    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:19.504086 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:19.503446    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" event={"ID":"412d056b-e379-4210-a954-218d50a78c51","Type":"ContainerStarted","Data":"9c86c367be290f2626821a1202da2a41cf0327c19b65aefe5a075917e07420a1"}
Jul 29 19:30:19.504086 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:19.503777    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:30:19.504086 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:19.503826    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:30:19.505428 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:19.505403    2531 generic.go:356] "Generic (PLEG): container finished" podID="fd909c25-730e-4522-93b2-b935f5b80db7" containerID="2d82cec5efc90b25387dc1a85ce82b20eb27f35e93c48197e9be8e2c6c372476" exitCode=0
Jul 29 19:30:19.505527 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:19.505441    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerDied","Data":"2d82cec5efc90b25387dc1a85ce82b20eb27f35e93c48197e9be8e2c6c372476"}
Jul 29 19:30:19.519851 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:19.519833    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:30:19.571593 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:19.571545    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg" podStartSLOduration=8.884953888 podStartE2EDuration="27.571530877s" totalImagesPullingTime="18.686576989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:19.570987105 +0000 UTC m=+27.725245737" watchObservedRunningTime="2026-07-29 19:30:19.571530877 +0000 UTC m=+27.725789495"
Jul 29 19:30:20.366205 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:20.366178    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:20.366441 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:20.366186    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:20.366441 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:20.366289    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:20.366441 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:20.366303    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:20.366441 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:20.366417    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:20.366638 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:20.366502    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:20.509380 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:20.509356    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:30:20.526447 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:20.526426    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:30:21.076753 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.076567    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kcnps"]
Jul 29 19:30:21.076897 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.076850    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:21.076939 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:21.076924    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:21.081426 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.081403    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljf4v"]
Jul 29 19:30:21.081559 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.081504    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:21.081609 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:21.081587    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:21.082178 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.082141    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rhc8g"]
Jul 29 19:30:21.082297 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.082238    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:21.082363 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:21.082305    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:21.512336 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.512300    2531 generic.go:356] "Generic (PLEG): container finished" podID="fd909c25-730e-4522-93b2-b935f5b80db7" containerID="58c676527fbea163da321fdfd943da367835dcedec0bd5f55b5083e424395f35" exitCode=0
Jul 29 19:30:21.512742 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:21.512361    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerDied","Data":"58c676527fbea163da321fdfd943da367835dcedec0bd5f55b5083e424395f35"}
Jul 29 19:30:22.367587 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:22.367558    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:22.367742 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:22.367648    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:23.366294 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:23.366234    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:23.366294 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:23.366277    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:23.366950 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:23.366355    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:23.366950 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:23.366724    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:23.519343 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:23.519312    2531 generic.go:356] "Generic (PLEG): container finished" podID="fd909c25-730e-4522-93b2-b935f5b80db7" containerID="4d93d04f686a90b510ddfbf9360d7bf94420616e6647f121c15d4de67438a427" exitCode=0
Jul 29 19:30:23.519465 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:23.519347    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerDied","Data":"4d93d04f686a90b510ddfbf9360d7bf94420616e6647f121c15d4de67438a427"}
Jul 29 19:30:24.366262 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:24.366231    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:24.366415 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:24.366379    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:25.366943 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:25.366912    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:25.367413 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:25.367020    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kcnps" podUID="1b7cb4ae-431a-4570-9244-7f94cf86e0e9"
Jul 29 19:30:25.367413 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:25.367114    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:25.367413 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:25.367230    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhc8g" podUID="0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901"
Jul 29 19:30:26.063250 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.063216    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:26.063442 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.063276    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:26.063442 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.063400    2531 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:30:26.063442 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.063402    2531 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 19:30:26.063591 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.063462    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs podName:985dc327-84a0-4719-8e62-74000ad36ea5 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:58.063445365 +0000 UTC m=+66.217703962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs") pod "network-metrics-daemon-ljf4v" (UID: "985dc327-84a0-4719-8e62-74000ad36ea5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 19:30:26.063591 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.063482    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret podName:0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:58.06347115 +0000 UTC m=+66.217729746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret") pod "global-pull-secret-syncer-rhc8g" (UID: "0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901") : object "kube-system"/"original-pull-secret" not registered
Jul 29 19:30:26.164651 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.164613    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:26.164823 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.164789    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 19:30:26.164823 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.164810    2531 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 19:30:26.164823 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.164823    2531 projected.go:196] Error preparing data for projected volume kube-api-access-9m8hk for pod openshift-network-diagnostics/network-check-target-kcnps: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:30:26.164950 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.164882    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk podName:1b7cb4ae-431a-4570-9244-7f94cf86e0e9 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:58.164866497 +0000 UTC m=+66.319125102 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8hk" (UniqueName: "kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk") pod "network-check-target-kcnps" (UID: "1b7cb4ae-431a-4570-9244-7f94cf86e0e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 19:30:26.366187 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.366159    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:26.366335 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.366291    2531 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljf4v" podUID="985dc327-84a0-4719-8e62-74000ad36ea5"
Jul 29 19:30:26.646922 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.646846    2531 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-41.ec2.internal" event="NodeReady"
Jul 29 19:30:26.647356 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.646986    2531 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 19:30:26.695169 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.695137    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb5867b4f-bnkzn"]
Jul 29 19:30:26.697552 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.697533    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.700239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.700218    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 19:30:26.700369 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.700268    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 19:30:26.700369 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.700229    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 19:30:26.700474 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.700308    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-95c74\""
Jul 29 19:30:26.706839 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.706820    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bf2bv"]
Jul 29 19:30:26.708086 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.708067    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 19:30:26.708851 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.708835    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.711462 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.711440    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 19:30:26.711654 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.711637    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8z4sg\""
Jul 29 19:30:26.711771 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.711751    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4b4kb"]
Jul 29 19:30:26.711869 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.711854    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 19:30:26.713445 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.713429    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:26.716370 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.715972    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 19:30:26.716370 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.716013    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 19:30:26.716370 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.716020    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ck8zl\""
Jul 29 19:30:26.716370 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.716029    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 19:30:26.722584 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.722544    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb5867b4f-bnkzn"]
Jul 29 19:30:26.728086 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.728047    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bf2bv"]
Jul 29 19:30:26.740764 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.740735    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4b4kb"]
Jul 29 19:30:26.868392 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868363    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqvg\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-kube-api-access-ngqvg\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868416    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868443    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-installation-pull-secrets\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868466    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt8gs\" (UniqueName: \"kubernetes.io/projected/116d0690-db5c-4337-8ca6-8f5b82918f63-kube-api-access-lt8gs\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.868579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868511    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a49f525-ae27-4e28-99b0-3b3d9fd1b693-cert\") pod \"ingress-canary-4b4kb\" (UID: \"5a49f525-ae27-4e28-99b0-3b3d9fd1b693\") " pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:26.868579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868552    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-image-registry-private-configuration\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868572    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6cb8c38-8b94-442c-abb2-6a6542346e6f-ca-trust-extracted\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868587    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-trusted-ca\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868603    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb75v\" (UniqueName: \"kubernetes.io/projected/5a49f525-ae27-4e28-99b0-3b3d9fd1b693-kube-api-access-zb75v\") pod \"ingress-canary-4b4kb\" (UID: \"5a49f525-ae27-4e28-99b0-3b3d9fd1b693\") " pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:26.868846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868621    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-bound-sa-token\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868644    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/116d0690-db5c-4337-8ca6-8f5b82918f63-config-volume\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.868846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868681    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-certificates\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.868846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868772    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.868846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.868809    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116d0690-db5c-4337-8ca6-8f5b82918f63-tmp-dir\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.969708 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.969672    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.969708 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.969707    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116d0690-db5c-4337-8ca6-8f5b82918f63-tmp-dir\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.969963 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.969745    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqvg\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-kube-api-access-ngqvg\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.969963 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.969838    2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:30:26.969963 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.969909    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls podName:116d0690-db5c-4337-8ca6-8f5b82918f63 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:27.46988774 +0000 UTC m=+35.624146355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls") pod "dns-default-bf2bv" (UID: "116d0690-db5c-4337-8ca6-8f5b82918f63") : secret "dns-default-metrics-tls" not found
Jul 29 19:30:26.970192 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970119    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/116d0690-db5c-4337-8ca6-8f5b82918f63-tmp-dir\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.970192 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970121    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.970192 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970178    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-installation-pull-secrets\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.970192 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.970189    2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:30:26.970306 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.970203    2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb5867b4f-bnkzn: secret "image-registry-tls" not found
Jul 29 19:30:26.970306 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970208    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt8gs\" (UniqueName: \"kubernetes.io/projected/116d0690-db5c-4337-8ca6-8f5b82918f63-kube-api-access-lt8gs\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.970306 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970231    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a49f525-ae27-4e28-99b0-3b3d9fd1b693-cert\") pod \"ingress-canary-4b4kb\" (UID: \"5a49f525-ae27-4e28-99b0-3b3d9fd1b693\") " pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:26.970306 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:26.970242    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls podName:f6cb8c38-8b94-442c-abb2-6a6542346e6f nodeName:}" failed. No retries permitted until 2026-07-29 19:30:27.470226881 +0000 UTC m=+35.624485484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls") pod "image-registry-5cb5867b4f-bnkzn" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f") : secret "image-registry-tls" not found
Jul 29 19:30:26.970306 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970277    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-image-registry-private-configuration\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.970306 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970296    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6cb8c38-8b94-442c-abb2-6a6542346e6f-ca-trust-extracted\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.970478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970317    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-trusted-ca\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.970478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970337    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb75v\" (UniqueName: \"kubernetes.io/projected/5a49f525-ae27-4e28-99b0-3b3d9fd1b693-kube-api-access-zb75v\") pod \"ingress-canary-4b4kb\" (UID: \"5a49f525-ae27-4e28-99b0-3b3d9fd1b693\") " pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:26.970478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970353    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-bound-sa-token\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.970478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970369    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/116d0690-db5c-4337-8ca6-8f5b82918f63-config-volume\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.970478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970388    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-certificates\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.971388 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.970862    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-certificates\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.971388 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.971213    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6cb8c38-8b94-442c-abb2-6a6542346e6f-ca-trust-extracted\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.971388 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.971340    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/116d0690-db5c-4337-8ca6-8f5b82918f63-config-volume\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:26.971597 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.971481    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-trusted-ca\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.975004 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.974860    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-image-registry-private-configuration\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.975136 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.974880    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-installation-pull-secrets\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.975136 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.974904    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a49f525-ae27-4e28-99b0-3b3d9fd1b693-cert\") pod \"ingress-canary-4b4kb\" (UID: \"5a49f525-ae27-4e28-99b0-3b3d9fd1b693\") " pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:26.983791 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.983767    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-bound-sa-token\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.983964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.983946    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqvg\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-kube-api-access-ngqvg\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:26.984678 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.984655    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb75v\" (UniqueName: \"kubernetes.io/projected/5a49f525-ae27-4e28-99b0-3b3d9fd1b693-kube-api-access-zb75v\") pod \"ingress-canary-4b4kb\" (UID: \"5a49f525-ae27-4e28-99b0-3b3d9fd1b693\") " pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:26.984973 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:26.984953    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt8gs\" (UniqueName: \"kubernetes.io/projected/116d0690-db5c-4337-8ca6-8f5b82918f63-kube-api-access-lt8gs\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:27.025560 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.025534    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4b4kb"
Jul 29 19:30:27.366925 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.366816    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:27.366925 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.366862    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:27.369454 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.369427    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:30:27.369614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.369478    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:30:27.369614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.369523    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qwcp5\""
Jul 29 19:30:27.369614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.369567    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:30:27.474217 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.474187    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:27.474383 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.474278    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:27.474461 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:27.474379    2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:30:27.474461 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:27.474404    2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:30:27.474461 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:27.474424    2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb5867b4f-bnkzn: secret "image-registry-tls" not found
Jul 29 19:30:27.474461 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:27.474454    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls podName:116d0690-db5c-4337-8ca6-8f5b82918f63 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:28.474437992 +0000 UTC m=+36.628696588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls") pod "dns-default-bf2bv" (UID: "116d0690-db5c-4337-8ca6-8f5b82918f63") : secret "dns-default-metrics-tls" not found
Jul 29 19:30:27.474630 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:27.474479    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls podName:f6cb8c38-8b94-442c-abb2-6a6542346e6f nodeName:}" failed. No retries permitted until 2026-07-29 19:30:28.474462045 +0000 UTC m=+36.628720649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls") pod "image-registry-5cb5867b4f-bnkzn" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f") : secret "image-registry-tls" not found
Jul 29 19:30:27.720081 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.720030    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4b4kb"]
Jul 29 19:30:27.726036 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:30:27.726008    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a49f525_ae27_4e28_99b0_3b3d9fd1b693.slice/crio-c07fef4e61def46dbb8e7bd6f299ec84d2b8818576d0d54306e0df947e608f1b WatchSource:0}: Error finding container c07fef4e61def46dbb8e7bd6f299ec84d2b8818576d0d54306e0df947e608f1b: Status 404 returned error can't find the container with id c07fef4e61def46dbb8e7bd6f299ec84d2b8818576d0d54306e0df947e608f1b
Jul 29 19:30:27.864550 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.864514    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"]
Jul 29 19:30:27.866185 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.866168    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:27.868514 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.868459    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 19:30:27.868514 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.868502    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 19:30:27.868640 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.868468    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w9c4z\""
Jul 29 19:30:27.881285 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.881258    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"]
Jul 29 19:30:27.977878 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.977841    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/810e31bc-c12c-42ca-aee7-310ad8a18cab-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:27.977878 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:27.977879    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:28.078866 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.078834    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/810e31bc-c12c-42ca-aee7-310ad8a18cab-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:28.078866 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.078868    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:28.079094 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.078963    2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 19:30:28.079094 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.079021    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert podName:810e31bc-c12c-42ca-aee7-310ad8a18cab nodeName:}" failed. No retries permitted until 2026-07-29 19:30:28.579008277 +0000 UTC m=+36.733266874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vkr8r" (UID: "810e31bc-c12c-42ca-aee7-310ad8a18cab") : secret "networking-console-plugin-cert" not found
Jul 29 19:30:28.079449 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.079431    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/810e31bc-c12c-42ca-aee7-310ad8a18cab-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:28.366484 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.366452    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:28.369075 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.369037    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:30:28.369075 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.369048    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xr6nn\""
Jul 29 19:30:28.481492 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.481446    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:28.481672 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.481578    2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:30:28.481672 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.481636    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls podName:116d0690-db5c-4337-8ca6-8f5b82918f63 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:30.481620988 +0000 UTC m=+38.635879585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls") pod "dns-default-bf2bv" (UID: "116d0690-db5c-4337-8ca6-8f5b82918f63") : secret "dns-default-metrics-tls" not found
Jul 29 19:30:28.481672 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.481667    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:28.481800 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.481743    2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:30:28.481800 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.481751    2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb5867b4f-bnkzn: secret "image-registry-tls" not found
Jul 29 19:30:28.481800 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.481773    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls podName:f6cb8c38-8b94-442c-abb2-6a6542346e6f nodeName:}" failed. No retries permitted until 2026-07-29 19:30:30.481766375 +0000 UTC m=+38.636024972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls") pod "image-registry-5cb5867b4f-bnkzn" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f") : secret "image-registry-tls" not found
Jul 29 19:30:28.534004 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.533978    2531 generic.go:356] "Generic (PLEG): container finished" podID="fd909c25-730e-4522-93b2-b935f5b80db7" containerID="7dec9337ef690f0cca506d03c8e9ebf0dd57b1268916e44899a5d920d2f81ce4" exitCode=0
Jul 29 19:30:28.534150 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.534047    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerDied","Data":"7dec9337ef690f0cca506d03c8e9ebf0dd57b1268916e44899a5d920d2f81ce4"}
Jul 29 19:30:28.535135 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.535118    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4b4kb" event={"ID":"5a49f525-ae27-4e28-99b0-3b3d9fd1b693","Type":"ContainerStarted","Data":"c07fef4e61def46dbb8e7bd6f299ec84d2b8818576d0d54306e0df947e608f1b"}
Jul 29 19:30:28.582516 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:28.582480    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:28.582635 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.582613    2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 19:30:28.582692 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:28.582682    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert podName:810e31bc-c12c-42ca-aee7-310ad8a18cab nodeName:}" failed. No retries permitted until 2026-07-29 19:30:29.582667423 +0000 UTC m=+37.736926020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vkr8r" (UID: "810e31bc-c12c-42ca-aee7-310ad8a18cab") : secret "networking-console-plugin-cert" not found
Jul 29 19:30:29.541853 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:29.541562    2531 generic.go:356] "Generic (PLEG): container finished" podID="fd909c25-730e-4522-93b2-b935f5b80db7" containerID="8bd202d9017f16f0a38f1014c3b8da9576810a4969bd0b1ee9387de1aad65e6e" exitCode=0
Jul 29 19:30:29.541853 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:29.541645    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerDied","Data":"8bd202d9017f16f0a38f1014c3b8da9576810a4969bd0b1ee9387de1aad65e6e"}
Jul 29 19:30:29.590452 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:29.590429    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:29.591331 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:29.591304    2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 19:30:29.591994 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:29.591388    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert podName:810e31bc-c12c-42ca-aee7-310ad8a18cab nodeName:}" failed. No retries permitted until 2026-07-29 19:30:31.591365526 +0000 UTC m=+39.745624124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vkr8r" (UID: "810e31bc-c12c-42ca-aee7-310ad8a18cab") : secret "networking-console-plugin-cert" not found
Jul 29 19:30:30.165031 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.164679    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pxkqn"]
Jul 29 19:30:30.169997 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.169976    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.172614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.172588    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8twzb\""
Jul 29 19:30:30.172818 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.172802    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 19:30:30.173044 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.173024    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 19:30:30.173887 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.173735    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 19:30:30.173887 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.173747    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 19:30:30.181808 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.181789    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxkqn"]
Jul 29 19:30:30.297374 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.297345    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.297374 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.297378    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2phzw\" (UniqueName: \"kubernetes.io/projected/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-api-access-2phzw\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.297616 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.297472    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.297616 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.297512    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-crio-socket\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.297616 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.297544    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-data-volume\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.398372 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.398340    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.398556 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.398379    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2phzw\" (UniqueName: \"kubernetes.io/projected/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-api-access-2phzw\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.398556 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.398502    2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:30:30.398665 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.398576    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:30.898555427 +0000 UTC m=+39.052814024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : configmap "kube-rbac-proxy" not found
Jul 29 19:30:30.398665 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.398605    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.398665 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.398651    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-crio-socket\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.398813 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.398682    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-data-volume\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.398813 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.398741    2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:30.398813 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.398805    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:30.898786907 +0000 UTC m=+39.053045524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:30.398958 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.398936    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-crio-socket\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.399070 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.399036    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-data-volume\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.409647 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.409619    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2phzw\" (UniqueName: \"kubernetes.io/projected/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-api-access-2phzw\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.499892 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.499862    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:30.500068 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.499969    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:30.500068 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.499997    2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:30:30.500068 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.500017    2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb5867b4f-bnkzn: secret "image-registry-tls" not found
Jul 29 19:30:30.500172 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.500086    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls podName:f6cb8c38-8b94-442c-abb2-6a6542346e6f nodeName:}" failed. No retries permitted until 2026-07-29 19:30:34.500067965 +0000 UTC m=+42.654326576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls") pod "image-registry-5cb5867b4f-bnkzn" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f") : secret "image-registry-tls" not found
Jul 29 19:30:30.500172 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.500136    2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:30:30.500233 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.500187    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls podName:116d0690-db5c-4337-8ca6-8f5b82918f63 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:34.500173712 +0000 UTC m=+42.654432309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls") pod "dns-default-bf2bv" (UID: "116d0690-db5c-4337-8ca6-8f5b82918f63") : secret "dns-default-metrics-tls" not found
Jul 29 19:30:30.546853 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.546822    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" event={"ID":"fd909c25-730e-4522-93b2-b935f5b80db7","Type":"ContainerStarted","Data":"2532f71489bf3024267c6ca82bd775762341ae0e56a5470b1b7bd21dc6151038"}
Jul 29 19:30:30.579690 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.579635    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5pw5s" podStartSLOduration=8.72555651 podStartE2EDuration="38.579620145s" totalImagesPullingTime="29.854063635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:30.578013398 +0000 UTC m=+38.732272017" watchObservedRunningTime="2026-07-29 19:30:30.579620145 +0000 UTC m=+38.733878762"
Jul 29 19:30:30.904446 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.904369    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.904598 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:30.904473    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:30.904598 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.904514    2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:30.904598 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.904576    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:31.904561139 +0000 UTC m=+40.058819739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:30.904598 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.904585    2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:30:30.904797 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:30.904634    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:31.904620181 +0000 UTC m=+40.058878781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : configmap "kube-rbac-proxy" not found
Jul 29 19:30:31.550914 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:31.550879    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4b4kb" event={"ID":"5a49f525-ae27-4e28-99b0-3b3d9fd1b693","Type":"ContainerStarted","Data":"4ae4b432db96b47ac1e20e5642314a398eb093c8e6f90449a76ce63c7b575c5b"}
Jul 29 19:30:31.569429 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:31.569388    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4b4kb" podStartSLOduration=2.358422085 podStartE2EDuration="5.569372533s" totalImagesPullingTime="3.210950448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:31.568626218 +0000 UTC m=+39.722884838" watchObservedRunningTime="2026-07-29 19:30:31.569372533 +0000 UTC m=+39.723631180"
Jul 29 19:30:31.610684 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:31.610659    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:31.610824 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:31.610806    2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 19:30:31.610879 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:31.610864    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert podName:810e31bc-c12c-42ca-aee7-310ad8a18cab nodeName:}" failed. No retries permitted until 2026-07-29 19:30:35.6108504 +0000 UTC m=+43.765108997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vkr8r" (UID: "810e31bc-c12c-42ca-aee7-310ad8a18cab") : secret "networking-console-plugin-cert" not found
Jul 29 19:30:31.912920 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:31.912837    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:31.912920 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:31.912906    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:31.913139 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:31.912970    2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:30:31.913139 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:31.912988    2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:31.913139 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:31.913029    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:33.913017036 +0000 UTC m=+42.067275632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:31.913139 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:31.913070    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:33.913035792 +0000 UTC m=+42.067294389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : configmap "kube-rbac-proxy" not found
Jul 29 19:30:33.158023 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:33.157995    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zw6kc_a5e00286-0955-436b-bf31-2e3787ce8c46/dns-node-resolver/0.log"
Jul 29 19:30:33.928134 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:33.928099    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:33.928289 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:33.928169    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:33.928289 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:33.928231    2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:30:33.928289 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:33.928257    2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:33.928400 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:33.928304    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:37.928287126 +0000 UTC m=+46.082545723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : configmap "kube-rbac-proxy" not found
Jul 29 19:30:33.928400 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:33.928319    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:37.928313395 +0000 UTC m=+46.082571992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:34.157204 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:34.157180    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvxnr_5bdc4868-d5c0-4f51-a622-2d53db99bdaf/node-ca/0.log"
Jul 29 19:30:34.531483 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:34.531448    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:34.531866 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:34.531521    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:34.531866 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:34.531594    2531 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 19:30:34.531866 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:34.531613    2531 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb5867b4f-bnkzn: secret "image-registry-tls" not found
Jul 29 19:30:34.531866 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:34.531633    2531 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 19:30:34.531866 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:34.531665    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls podName:f6cb8c38-8b94-442c-abb2-6a6542346e6f nodeName:}" failed. No retries permitted until 2026-07-29 19:30:42.531652006 +0000 UTC m=+50.685910607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls") pod "image-registry-5cb5867b4f-bnkzn" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f") : secret "image-registry-tls" not found
Jul 29 19:30:34.531866 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:34.531682    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls podName:116d0690-db5c-4337-8ca6-8f5b82918f63 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:42.531671291 +0000 UTC m=+50.685929888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls") pod "dns-default-bf2bv" (UID: "116d0690-db5c-4337-8ca6-8f5b82918f63") : secret "dns-default-metrics-tls" not found
Jul 29 19:30:34.557748 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:34.557688    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4b4kb_5a49f525-ae27-4e28-99b0-3b3d9fd1b693/serve-healthcheck-canary/0.log"
Jul 29 19:30:35.642340 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:35.642303    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:35.642705 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:35.642455    2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 19:30:35.642705 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:35.642522    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert podName:810e31bc-c12c-42ca-aee7-310ad8a18cab nodeName:}" failed. No retries permitted until 2026-07-29 19:30:43.642506228 +0000 UTC m=+51.796764825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vkr8r" (UID: "810e31bc-c12c-42ca-aee7-310ad8a18cab") : secret "networking-console-plugin-cert" not found
Jul 29 19:30:37.961320 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:37.961290    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:37.961805 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:37.961359    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:37.961805 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:37.961418    2531 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 19:30:37.961805 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:37.961449    2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:37.961805 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:37.961468    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:45.961455426 +0000 UTC m=+54.115714023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : configmap "kube-rbac-proxy" not found
Jul 29 19:30:37.961805 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:37.961500    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:30:45.961486664 +0000 UTC m=+54.115745264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:42.598216 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.598179    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:42.598592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.598261    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:42.600886 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.600869    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"image-registry-5cb5867b4f-bnkzn\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") " pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:42.600940 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.600864    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/116d0690-db5c-4337-8ca6-8f5b82918f63-metrics-tls\") pod \"dns-default-bf2bv\" (UID: \"116d0690-db5c-4337-8ca6-8f5b82918f63\") " pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:42.609779 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.609756    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:42.619905 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.619882    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:42.793233 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.793198    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb5867b4f-bnkzn"]
Jul 29 19:30:42.797023 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:30:42.796990    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cb8c38_8b94_442c_abb2_6a6542346e6f.slice/crio-dc6f599e95a7d5a4ff426bdb114fb0963100df1e0466ac06a0cfab81f0a524d2 WatchSource:0}: Error finding container dc6f599e95a7d5a4ff426bdb114fb0963100df1e0466ac06a0cfab81f0a524d2: Status 404 returned error can't find the container with id dc6f599e95a7d5a4ff426bdb114fb0963100df1e0466ac06a0cfab81f0a524d2
Jul 29 19:30:42.809190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:42.809160    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bf2bv"]
Jul 29 19:30:42.813754 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:30:42.813721    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116d0690_db5c_4337_8ca6_8f5b82918f63.slice/crio-3e4077fa49fb69b90fe6f8f74c5a48576d30764189ad6a8476a295243bb2dcf4 WatchSource:0}: Error finding container 3e4077fa49fb69b90fe6f8f74c5a48576d30764189ad6a8476a295243bb2dcf4: Status 404 returned error can't find the container with id 3e4077fa49fb69b90fe6f8f74c5a48576d30764189ad6a8476a295243bb2dcf4
Jul 29 19:30:43.579843 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:43.579801    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bf2bv" event={"ID":"116d0690-db5c-4337-8ca6-8f5b82918f63","Type":"ContainerStarted","Data":"3e4077fa49fb69b90fe6f8f74c5a48576d30764189ad6a8476a295243bb2dcf4"}
Jul 29 19:30:43.581510 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:43.581479    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn" event={"ID":"f6cb8c38-8b94-442c-abb2-6a6542346e6f","Type":"ContainerStarted","Data":"382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8"}
Jul 29 19:30:43.581653 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:43.581525    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn" event={"ID":"f6cb8c38-8b94-442c-abb2-6a6542346e6f","Type":"ContainerStarted","Data":"dc6f599e95a7d5a4ff426bdb114fb0963100df1e0466ac06a0cfab81f0a524d2"}
Jul 29 19:30:43.581719 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:43.581646    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:30:43.605745 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:43.605688    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn" podStartSLOduration=22.605668987 podStartE2EDuration="22.605668987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:43.603989104 +0000 UTC m=+51.758247724" watchObservedRunningTime="2026-07-29 19:30:43.605668987 +0000 UTC m=+51.759927607"
Jul 29 19:30:43.707107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:43.707066    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:43.707274 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:43.707225    2531 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 19:30:43.707337 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:43.707326    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert podName:810e31bc-c12c-42ca-aee7-310ad8a18cab nodeName:}" failed. No retries permitted until 2026-07-29 19:30:59.707304111 +0000 UTC m=+67.861562709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-vkr8r" (UID: "810e31bc-c12c-42ca-aee7-310ad8a18cab") : secret "networking-console-plugin-cert" not found
Jul 29 19:30:45.589089 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:45.589036    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bf2bv" event={"ID":"116d0690-db5c-4337-8ca6-8f5b82918f63","Type":"ContainerStarted","Data":"d3d178ee30822f17a7131b9233111cbcead4e1c1b8bc45adaac03be3901e6d78"}
Jul 29 19:30:45.589491 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:45.589113    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bf2bv" event={"ID":"116d0690-db5c-4337-8ca6-8f5b82918f63","Type":"ContainerStarted","Data":"43e124c68187ec7b84c5e69dcbe56c20a279b82082d13ab67dd76cecdce63964"}
Jul 29 19:30:45.589491 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:45.589215    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:45.627791 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:45.627748    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bf2bv" podStartSLOduration=17.3935136 podStartE2EDuration="19.627733796s" totalImagesPullingTime="2.234220196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:30:45.627357635 +0000 UTC m=+53.781616260" watchObservedRunningTime="2026-07-29 19:30:45.627733796 +0000 UTC m=+53.781992438"
Jul 29 19:30:46.025280 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:46.025248    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:46.025474 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:46.025312    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:46.025474 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:46.025402    2531 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:46.025474 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:30:46.025462    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls podName:e1fbdccb-dbb0-4f59-aad1-c2b9c2332006 nodeName:}" failed. No retries permitted until 2026-07-29 19:31:02.025448508 +0000 UTC m=+70.179707105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pxkqn" (UID: "e1fbdccb-dbb0-4f59-aad1-c2b9c2332006") : secret "insights-runtime-extractor-tls" not found
Jul 29 19:30:46.025846 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:46.025823    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:30:52.531845 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:52.531818    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r85vg"
Jul 29 19:30:55.346041 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.346010    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"]
Jul 29 19:30:55.348978 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.348951    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.350105 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.350084    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"]
Jul 29 19:30:55.351750 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.351719    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 19:30:55.352974 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.352946    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 19:30:55.353304 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.353283    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 19:30:55.353532 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.353516    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 19:30:55.353856 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.353841    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-znj7z\""
Jul 29 19:30:55.354082 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.354041    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.356504 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.356484    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 29 19:30:55.356617 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.356538    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 29 19:30:55.356683 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.356635    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 29 19:30:55.356683 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.356648    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 29 19:30:55.362576 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.362559    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"]
Jul 29 19:30:55.368554 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.368508    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"]
Jul 29 19:30:55.399369 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399344    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-ca\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.399475 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399406    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c0f16a-604f-4f5d-b6e0-107fc8496d96-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.399475 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399437    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4z4l\" (UniqueName: \"kubernetes.io/projected/94c0f16a-604f-4f5d-b6e0-107fc8496d96-kube-api-access-j4z4l\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.399642 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399482    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10a8546d-3820-4401-b58e-2ab9e1a80ccb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-674d977676-jgxwn\" (UID: \"10a8546d-3820-4401-b58e-2ab9e1a80ccb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.399642 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399561    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.399642 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399601    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gsl\" (UniqueName: \"kubernetes.io/projected/10a8546d-3820-4401-b58e-2ab9e1a80ccb-kube-api-access-59gsl\") pod \"managed-serviceaccount-addon-agent-674d977676-jgxwn\" (UID: \"10a8546d-3820-4401-b58e-2ab9e1a80ccb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.399642 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399628    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-hub\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.399793 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.399651    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.419967 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.419941    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb5867b4f-bnkzn"]
Jul 29 19:30:55.500223 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500191    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10a8546d-3820-4401-b58e-2ab9e1a80ccb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-674d977676-jgxwn\" (UID: \"10a8546d-3820-4401-b58e-2ab9e1a80ccb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.500418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500232    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.500418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500260    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59gsl\" (UniqueName: \"kubernetes.io/projected/10a8546d-3820-4401-b58e-2ab9e1a80ccb-kube-api-access-59gsl\") pod \"managed-serviceaccount-addon-agent-674d977676-jgxwn\" (UID: \"10a8546d-3820-4401-b58e-2ab9e1a80ccb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.500418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500277    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-hub\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.500418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500299    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.500637 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500505    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-ca\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.500637 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500574    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c0f16a-604f-4f5d-b6e0-107fc8496d96-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.500637 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.500600    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4z4l\" (UniqueName: \"kubernetes.io/projected/94c0f16a-604f-4f5d-b6e0-107fc8496d96-kube-api-access-j4z4l\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.501524 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.501499    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c0f16a-604f-4f5d-b6e0-107fc8496d96-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.503043 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.503016    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.503162 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.503120    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10a8546d-3820-4401-b58e-2ab9e1a80ccb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-674d977676-jgxwn\" (UID: \"10a8546d-3820-4401-b58e-2ab9e1a80ccb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.503209 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.503185    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.503407 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.503387    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-ca\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.503484 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.503469    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94c0f16a-604f-4f5d-b6e0-107fc8496d96-hub\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.510299 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.510279    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4z4l\" (UniqueName: \"kubernetes.io/projected/94c0f16a-604f-4f5d-b6e0-107fc8496d96-kube-api-access-j4z4l\") pod \"cluster-proxy-proxy-agent-64f5859bdd-rcf4l\" (UID: \"94c0f16a-604f-4f5d-b6e0-107fc8496d96\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.510730 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.510709    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gsl\" (UniqueName: \"kubernetes.io/projected/10a8546d-3820-4401-b58e-2ab9e1a80ccb-kube-api-access-59gsl\") pod \"managed-serviceaccount-addon-agent-674d977676-jgxwn\" (UID: \"10a8546d-3820-4401-b58e-2ab9e1a80ccb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.593244 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.593221    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bf2bv"
Jul 29 19:30:55.668843 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.668762    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"
Jul 29 19:30:55.674157 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.674135    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"
Jul 29 19:30:55.810436 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.810402    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn"]
Jul 29 19:30:55.813564 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:30:55.813541    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10a8546d_3820_4401_b58e_2ab9e1a80ccb.slice/crio-659ac54471b98f504968cad04e490b194e12bfaf16f3f01d16ed888cab6b72d5 WatchSource:0}: Error finding container 659ac54471b98f504968cad04e490b194e12bfaf16f3f01d16ed888cab6b72d5: Status 404 returned error can't find the container with id 659ac54471b98f504968cad04e490b194e12bfaf16f3f01d16ed888cab6b72d5
Jul 29 19:30:55.826184 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:55.826165    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l"]
Jul 29 19:30:55.829382 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:30:55.829343    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94c0f16a_604f_4f5d_b6e0_107fc8496d96.slice/crio-d2c9cb5b6d8e198e0d174605b1028c0b8be0a9686f46ecf3a044e9ec87dbf972 WatchSource:0}: Error finding container d2c9cb5b6d8e198e0d174605b1028c0b8be0a9686f46ecf3a044e9ec87dbf972: Status 404 returned error can't find the container with id d2c9cb5b6d8e198e0d174605b1028c0b8be0a9686f46ecf3a044e9ec87dbf972
Jul 29 19:30:56.615802 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:56.615768    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn" event={"ID":"10a8546d-3820-4401-b58e-2ab9e1a80ccb","Type":"ContainerStarted","Data":"659ac54471b98f504968cad04e490b194e12bfaf16f3f01d16ed888cab6b72d5"}
Jul 29 19:30:56.616787 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:56.616766    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l" event={"ID":"94c0f16a-604f-4f5d-b6e0-107fc8496d96","Type":"ContainerStarted","Data":"d2c9cb5b6d8e198e0d174605b1028c0b8be0a9686f46ecf3a044e9ec87dbf972"}
Jul 29 19:30:58.123495 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.123451    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:58.123945 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.123577    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:58.126191 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.126153    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 19:30:58.127399 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.127211    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 19:30:58.136870 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.136850    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901-original-pull-secret\") pod \"global-pull-secret-syncer-rhc8g\" (UID: \"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901\") " pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:58.136971 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.136908    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/985dc327-84a0-4719-8e62-74000ad36ea5-metrics-certs\") pod \"network-metrics-daemon-ljf4v\" (UID: \"985dc327-84a0-4719-8e62-74000ad36ea5\") " pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:58.224394 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.224361    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:58.226945 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.226909    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 19:30:58.237311 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.237121    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 19:30:58.248241 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.248216    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8hk\" (UniqueName: \"kubernetes.io/projected/1b7cb4ae-431a-4570-9244-7f94cf86e0e9-kube-api-access-9m8hk\") pod \"network-check-target-kcnps\" (UID: \"1b7cb4ae-431a-4570-9244-7f94cf86e0e9\") " pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:58.278115 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.278084    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhc8g"
Jul 29 19:30:58.286651 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.286609    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qwcp5\""
Jul 29 19:30:58.295160 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.295133    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:30:58.377470 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.377390    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xr6nn\""
Jul 29 19:30:58.385730 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:58.385560    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljf4v"
Jul 29 19:30:59.736750 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:59.736715    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:59.739491 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:59.739464    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/810e31bc-c12c-42ca-aee7-310ad8a18cab-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-vkr8r\" (UID: \"810e31bc-c12c-42ca-aee7-310ad8a18cab\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:30:59.977041 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:59.977003    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w9c4z\""
Jul 29 19:30:59.985144 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:30:59.985109    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"
Jul 29 19:31:01.022504 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.022479    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kcnps"]
Jul 29 19:31:01.032566 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.032020    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rhc8g"]
Jul 29 19:31:01.037870 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:31:01.037843    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0a7dc2_9efc_43b0_bd20_0aeda1a3a901.slice/crio-2e54df94f8299081bff11fb76fb5844f5af698477d3f1e2ac83dc20a508e8834 WatchSource:0}: Error finding container 2e54df94f8299081bff11fb76fb5844f5af698477d3f1e2ac83dc20a508e8834: Status 404 returned error can't find the container with id 2e54df94f8299081bff11fb76fb5844f5af698477d3f1e2ac83dc20a508e8834
Jul 29 19:31:01.052744 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.052723    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r"]
Jul 29 19:31:01.056740 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:31:01.056705    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810e31bc_c12c_42ca_aee7_310ad8a18cab.slice/crio-9384b8c6959bad1b18ae323481362c37272d4570b151ca9921ae283a23f783a7 WatchSource:0}: Error finding container 9384b8c6959bad1b18ae323481362c37272d4570b151ca9921ae283a23f783a7: Status 404 returned error can't find the container with id 9384b8c6959bad1b18ae323481362c37272d4570b151ca9921ae283a23f783a7
Jul 29 19:31:01.257232 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.257212    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljf4v"]
Jul 29 19:31:01.259303 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:31:01.259280    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985dc327_84a0_4719_8e62_74000ad36ea5.slice/crio-37622d0b89412acaa8c6b4c87bbefcff730a51abde1d96933983d1f2cf9f12e5 WatchSource:0}: Error finding container 37622d0b89412acaa8c6b4c87bbefcff730a51abde1d96933983d1f2cf9f12e5: Status 404 returned error can't find the container with id 37622d0b89412acaa8c6b4c87bbefcff730a51abde1d96933983d1f2cf9f12e5
Jul 29 19:31:01.634243 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.634203    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljf4v" event={"ID":"985dc327-84a0-4719-8e62-74000ad36ea5","Type":"ContainerStarted","Data":"37622d0b89412acaa8c6b4c87bbefcff730a51abde1d96933983d1f2cf9f12e5"}
Jul 29 19:31:01.640618 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.640581    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rhc8g" event={"ID":"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901","Type":"ContainerStarted","Data":"2e54df94f8299081bff11fb76fb5844f5af698477d3f1e2ac83dc20a508e8834"}
Jul 29 19:31:01.645122 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.644567    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l" event={"ID":"94c0f16a-604f-4f5d-b6e0-107fc8496d96","Type":"ContainerStarted","Data":"aeddcf343edd0561994891dab690aabe3f821e55bdf0ebbb6c223e77666895e7"}
Jul 29 19:31:01.645122 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.644610    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l" event={"ID":"94c0f16a-604f-4f5d-b6e0-107fc8496d96","Type":"ContainerStarted","Data":"43f013877646e0858901cbc8f38fe1dde58765e459d178477f2ccfd5be1ee9b0"}
Jul 29 19:31:01.645122 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.644632    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l" event={"ID":"94c0f16a-604f-4f5d-b6e0-107fc8496d96","Type":"ContainerStarted","Data":"38691febf6b98ee95e861fd28134910fa19768fb0498468d9640bedacd5cce87"}
Jul 29 19:31:01.646911 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.646487    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kcnps" event={"ID":"1b7cb4ae-431a-4570-9244-7f94cf86e0e9","Type":"ContainerStarted","Data":"33871ffb193e115d698861e7487fd033bf06831265222068e308e99f0f51c8ea"}
Jul 29 19:31:01.649825 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.649788    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn" event={"ID":"10a8546d-3820-4401-b58e-2ab9e1a80ccb","Type":"ContainerStarted","Data":"8c2e602cfe2c28ae4d9ceff534add36ad947eab5331cc866fea20a3f78e238b9"}
Jul 29 19:31:01.651234 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.651204    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r" event={"ID":"810e31bc-c12c-42ca-aee7-310ad8a18cab","Type":"ContainerStarted","Data":"9384b8c6959bad1b18ae323481362c37272d4570b151ca9921ae283a23f783a7"}
Jul 29 19:31:01.670024 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.669974    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64f5859bdd-rcf4l" podStartSLOduration=1.626165383 podStartE2EDuration="6.669961946s" totalImagesPullingTime="5.043796563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:01.66880661 +0000 UTC m=+69.823065230" watchObservedRunningTime="2026-07-29 19:31:01.669961946 +0000 UTC m=+69.824220544"
Jul 29 19:31:01.688500 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:01.688434    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-674d977676-jgxwn" podStartSLOduration=1.64666923 podStartE2EDuration="6.68841446s" totalImagesPullingTime="5.04174523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:01.687165712 +0000 UTC m=+69.841424333" watchObservedRunningTime="2026-07-29 19:31:01.68841446 +0000 UTC m=+69.842673079"
Jul 29 19:31:02.056726 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:02.056685    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:31:02.060560 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:02.060527    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1fbdccb-dbb0-4f59-aad1-c2b9c2332006-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxkqn\" (UID: \"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006\") " pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:31:02.284516 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:02.284487    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8twzb\""
Jul 29 19:31:02.292852 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:02.292812    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxkqn"
Jul 29 19:31:03.105161 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:03.105074    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxkqn"]
Jul 29 19:31:03.112015 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:31:03.111973    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1fbdccb_dbb0_4f59_aad1_c2b9c2332006.slice/crio-202a9b2219c8eb9cd0f1c14b5dd7f63e935c0264f5076bbd9ce6eae0db2fea7f WatchSource:0}: Error finding container 202a9b2219c8eb9cd0f1c14b5dd7f63e935c0264f5076bbd9ce6eae0db2fea7f: Status 404 returned error can't find the container with id 202a9b2219c8eb9cd0f1c14b5dd7f63e935c0264f5076bbd9ce6eae0db2fea7f
Jul 29 19:31:03.665127 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:03.664363    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r" event={"ID":"810e31bc-c12c-42ca-aee7-310ad8a18cab","Type":"ContainerStarted","Data":"7e079059584d5c44b32df721a093baea110c1543351323aafd3772f2ac5df8cd"}
Jul 29 19:31:03.667416 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:03.667381    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljf4v" event={"ID":"985dc327-84a0-4719-8e62-74000ad36ea5","Type":"ContainerStarted","Data":"187a61663d7a2f405cc36d1f2c169e4b10ebf85f2b02b3d4084873d07b077cf1"}
Jul 29 19:31:03.667563 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:03.667437    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljf4v" event={"ID":"985dc327-84a0-4719-8e62-74000ad36ea5","Type":"ContainerStarted","Data":"9353a2587e9d83592ef536a03e4fabf16f686735b6c997c99211ab03a67b43eb"}
Jul 29 19:31:03.668895 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:03.668831    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxkqn" event={"ID":"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006","Type":"ContainerStarted","Data":"202a9b2219c8eb9cd0f1c14b5dd7f63e935c0264f5076bbd9ce6eae0db2fea7f"}
Jul 29 19:31:03.684660 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:03.684605    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-vkr8r" podStartSLOduration=34.801475383 podStartE2EDuration="36.684586227s" totalImagesPullingTime="1.883110844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:03.684037932 +0000 UTC m=+71.838296552" watchObservedRunningTime="2026-07-29 19:31:03.684586227 +0000 UTC m=+71.838844846"
Jul 29 19:31:03.706644 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:03.706601    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ljf4v" podStartSLOduration=70.024603385 podStartE2EDuration="1m11.706584599s" totalImagesPullingTime="1.681981214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:03.70622868 +0000 UTC m=+71.860487300" watchObservedRunningTime="2026-07-29 19:31:03.706584599 +0000 UTC m=+71.860843219"
Jul 29 19:31:04.678559 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:04.678479    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kcnps" event={"ID":"1b7cb4ae-431a-4570-9244-7f94cf86e0e9","Type":"ContainerStarted","Data":"04a9f6e3c2873fbd1e2b378d24363f04c86fccdfeb7f8f7e3b6c60dc31170f00"}
Jul 29 19:31:04.679135 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:04.678805    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:31:05.426714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:05.426679    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:31:05.463796 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:05.463736    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kcnps" podStartSLOduration=70.11752622 podStartE2EDuration="1m13.463713909s" totalImagesPullingTime="3.346187689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:04.697375945 +0000 UTC m=+72.851634568" watchObservedRunningTime="2026-07-29 19:31:05.463713909 +0000 UTC m=+73.617972528"
Jul 29 19:31:06.690126 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:06.690093    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rhc8g" event={"ID":"0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901","Type":"ContainerStarted","Data":"879518737afb15653f45b2c1b311496b89ed6aee8a723bcd472e51feb4244169"}
Jul 29 19:31:06.712239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:06.712186    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rhc8g" podStartSLOduration=69.412800823 podStartE2EDuration="1m14.71216648s" totalImagesPullingTime="5.299365657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:06.711690855 +0000 UTC m=+74.865949475" watchObservedRunningTime="2026-07-29 19:31:06.71216648 +0000 UTC m=+74.866425100"
Jul 29 19:31:07.432894 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.432849    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dsn5z"]
Jul 29 19:31:07.449420 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.449387    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.452211 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.452184    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 19:31:07.452354 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.452219    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 19:31:07.452542 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.452523    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 19:31:07.452637 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.452560    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 19:31:07.452637 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.452621    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 19:31:07.453657 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.453639    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qvrbw\""
Jul 29 19:31:07.453758 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.453671    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 19:31:07.510048 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510012    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-accelerators-collector-config\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510048 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510066    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chqgc\" (UniqueName: \"kubernetes.io/projected/755d07d1-d1ba-41ea-88c5-cf689b7d5684-kube-api-access-chqgc\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510288 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510096    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/755d07d1-d1ba-41ea-88c5-cf689b7d5684-metrics-client-ca\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510288 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510120    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-sys\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510288 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510170    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-tls\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510288 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510211    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-textfile\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510288 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510277    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-wtmp\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510511 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510337    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.510511 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.510373    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-root\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611306 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611267    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-textfile\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611306 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611313    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-wtmp\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611336    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611359    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-root\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611389    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-accelerators-collector-config\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611418    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chqgc\" (UniqueName: \"kubernetes.io/projected/755d07d1-d1ba-41ea-88c5-cf689b7d5684-kube-api-access-chqgc\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611440    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/755d07d1-d1ba-41ea-88c5-cf689b7d5684-metrics-client-ca\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611459    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-sys\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611482    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-tls\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611509    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-wtmp\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.611592 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:31:07.611582    2531 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 19:31:07.612376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611620    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-textfile\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.612376 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:31:07.611638    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-tls podName:755d07d1-d1ba-41ea-88c5-cf689b7d5684 nodeName:}" failed. No retries permitted until 2026-07-29 19:31:08.111616834 +0000 UTC m=+76.265875430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-tls") pod "node-exporter-dsn5z" (UID: "755d07d1-d1ba-41ea-88c5-cf689b7d5684") : secret "node-exporter-tls" not found
Jul 29 19:31:07.612376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611701    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-root\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.612376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.611774    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/755d07d1-d1ba-41ea-88c5-cf689b7d5684-sys\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.612376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.612168    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-accelerators-collector-config\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.612376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.612263    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/755d07d1-d1ba-41ea-88c5-cf689b7d5684-metrics-client-ca\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.614337 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.614304    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:07.622600 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:07.622577    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chqgc\" (UniqueName: \"kubernetes.io/projected/755d07d1-d1ba-41ea-88c5-cf689b7d5684-kube-api-access-chqgc\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:08.115345 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:08.115311    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-tls\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:08.119124 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:08.119094    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/755d07d1-d1ba-41ea-88c5-cf689b7d5684-node-exporter-tls\") pod \"node-exporter-dsn5z\" (UID: \"755d07d1-d1ba-41ea-88c5-cf689b7d5684\") " pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:08.361328 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:08.361289    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dsn5z"
Jul 29 19:31:09.163866 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:31:09.163819    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755d07d1_d1ba_41ea_88c5_cf689b7d5684.slice/crio-1a9498697d40e27c3c511ae2ea5f3d64cb2cf720cca396c49e0337337c607b86 WatchSource:0}: Error finding container 1a9498697d40e27c3c511ae2ea5f3d64cb2cf720cca396c49e0337337c607b86: Status 404 returned error can't find the container with id 1a9498697d40e27c3c511ae2ea5f3d64cb2cf720cca396c49e0337337c607b86
Jul 29 19:31:09.703486 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:09.703445    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsn5z" event={"ID":"755d07d1-d1ba-41ea-88c5-cf689b7d5684","Type":"ContainerStarted","Data":"1a9498697d40e27c3c511ae2ea5f3d64cb2cf720cca396c49e0337337c607b86"}
Jul 29 19:31:09.705117 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:09.705088    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxkqn" event={"ID":"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006","Type":"ContainerStarted","Data":"151a625b636b7550727aa25eb7f864fa3fcc7faae49a88e7113dd1d34e2de34d"}
Jul 29 19:31:10.710556 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:10.710524    2531 generic.go:356] "Generic (PLEG): container finished" podID="755d07d1-d1ba-41ea-88c5-cf689b7d5684" containerID="d63da434733bd266b1b35832a69b9c5910b11f541de2baecbbb67e64de31be24" exitCode=0
Jul 29 19:31:10.710957 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:10.710594    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsn5z" event={"ID":"755d07d1-d1ba-41ea-88c5-cf689b7d5684","Type":"ContainerDied","Data":"d63da434733bd266b1b35832a69b9c5910b11f541de2baecbbb67e64de31be24"}
Jul 29 19:31:11.716917 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:11.716872    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsn5z" event={"ID":"755d07d1-d1ba-41ea-88c5-cf689b7d5684","Type":"ContainerStarted","Data":"6ddb74c61d693a053bc997cd0ebc019f77bd61069e12384d6ae694673c9bae3c"}
Jul 29 19:31:11.717357 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:11.716988    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dsn5z" event={"ID":"755d07d1-d1ba-41ea-88c5-cf689b7d5684","Type":"ContainerStarted","Data":"820c19813566303e808a042e9a81258194bff9565e6b7a2bab1b381607933ce8"}
Jul 29 19:31:11.743002 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:11.742936    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dsn5z" podStartSLOduration=3.711377697 podStartE2EDuration="4.742919981s" totalImagesPullingTime="961.871766ms" totalInitContainerRuntime="69.670518ms" isStatefulPod=true podCreationTimestamp="2026-07-29 19:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:11.741507226 +0000 UTC m=+79.895765848" watchObservedRunningTime="2026-07-29 19:31:11.742919981 +0000 UTC m=+79.897178599"
Jul 29 19:31:13.729330 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:13.729293    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxkqn" event={"ID":"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006","Type":"ContainerStarted","Data":"57b980f21b8f946788774520740125828f9ba54564fa97ccdbb8afe989b450b7"}
Jul 29 19:31:17.744415 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:17.744375    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxkqn" event={"ID":"e1fbdccb-dbb0-4f59-aad1-c2b9c2332006","Type":"ContainerStarted","Data":"d8c867a46626319cd16095b05a1ac8aaf5f56100abd3ea4af62ec9fa1aa2d53b"}
Jul 29 19:31:17.774996 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:17.774951    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pxkqn" podStartSLOduration=34.219069872 podStartE2EDuration="47.774936068s" totalImagesPullingTime="13.555866196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:30:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:31:17.773022041 +0000 UTC m=+85.927280660" watchObservedRunningTime="2026-07-29 19:31:17.774936068 +0000 UTC m=+85.929194687"
Jul 29 19:31:20.438474 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.438416    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn" podUID="f6cb8c38-8b94-442c-abb2-6a6542346e6f" containerName="registry" containerID="cri-o://382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8" gracePeriod=30
Jul 29 19:31:20.682589 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.682567    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:31:20.754376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.754293    2531 generic.go:356] "Generic (PLEG): container finished" podID="f6cb8c38-8b94-442c-abb2-6a6542346e6f" containerID="382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8" exitCode=0
Jul 29 19:31:20.754376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.754332    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn" event={"ID":"f6cb8c38-8b94-442c-abb2-6a6542346e6f","Type":"ContainerDied","Data":"382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8"}
Jul 29 19:31:20.754376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.754342    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn"
Jul 29 19:31:20.754376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.754367    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb5867b4f-bnkzn" event={"ID":"f6cb8c38-8b94-442c-abb2-6a6542346e6f","Type":"ContainerDied","Data":"dc6f599e95a7d5a4ff426bdb114fb0963100df1e0466ac06a0cfab81f0a524d2"}
Jul 29 19:31:20.755319 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.755308    2531 scope.go:117] "RemoveContainer" containerID="382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8"
Jul 29 19:31:20.763307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.763291    2531 scope.go:117] "RemoveContainer" containerID="382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8"
Jul 29 19:31:20.763579 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:31:20.763560    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8\": container with ID starting with 382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8 not found: ID does not exist" containerID="382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8"
Jul 29 19:31:20.763624 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.763589    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8"} err="failed to get container status \"382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8\": rpc error: code = NotFound desc = could not find container \"382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8\": container with ID starting with 382dd80b5751fd8112e19134868de6844ea37f8350596874cd84c4f466b539a8 not found: ID does not exist"
Jul 29 19:31:20.819857 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.819833    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngqvg\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-kube-api-access-ngqvg\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.819964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.819877    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-certificates\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.819964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.819897    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-bound-sa-token\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.819964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.819941    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-trusted-ca\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.819964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.819962    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-installation-pull-secrets\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.820200 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.819986    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-image-registry-private-configuration\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.820200 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.820026    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.820200 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.820048    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6cb8c38-8b94-442c-abb2-6a6542346e6f-ca-trust-extracted\") pod \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\" (UID: \"f6cb8c38-8b94-442c-abb2-6a6542346e6f\") "
Jul 29 19:31:20.820368 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.820321    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:31:20.820523 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.820494    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:31:20.822948 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.822922    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-kube-api-access-ngqvg" (OuterVolumeSpecName: "kube-api-access-ngqvg") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "kube-api-access-ngqvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:31:20.823040 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.822995    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:31:20.823191 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.823173    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:31:20.823250 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.823193    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:31:20.823250 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.823231    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:31:20.828802 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.828780    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6cb8c38-8b94-442c-abb2-6a6542346e6f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f6cb8c38-8b94-442c-abb2-6a6542346e6f" (UID: "f6cb8c38-8b94-442c-abb2-6a6542346e6f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:31:20.921113 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921085    2531 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-trusted-ca\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:20.921113 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921108    2531 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-installation-pull-secrets\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:20.921113 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921119    2531 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6cb8c38-8b94-442c-abb2-6a6542346e6f-image-registry-private-configuration\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:20.921307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921129    2531 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-tls\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:20.921307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921138    2531 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6cb8c38-8b94-442c-abb2-6a6542346e6f-ca-trust-extracted\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:20.921307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921148    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngqvg\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-kube-api-access-ngqvg\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:20.921307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921155    2531 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6cb8c38-8b94-442c-abb2-6a6542346e6f-registry-certificates\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:20.921307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:20.921163    2531 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6cb8c38-8b94-442c-abb2-6a6542346e6f-bound-sa-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:31:21.078180 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:21.078148    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb5867b4f-bnkzn"]
Jul 29 19:31:21.082661 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:21.082638    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cb5867b4f-bnkzn"]
Jul 29 19:31:22.370408 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:22.370382    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6cb8c38-8b94-442c-abb2-6a6542346e6f" path="/var/lib/kubelet/pods/f6cb8c38-8b94-442c-abb2-6a6542346e6f/volumes"
Jul 29 19:31:35.684544 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:31:35.684515    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kcnps"
Jul 29 19:34:34.166307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.166269    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"]
Jul 29 19:34:34.166728 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.166499    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6cb8c38-8b94-442c-abb2-6a6542346e6f" containerName="registry"
Jul 29 19:34:34.166728 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.166509    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6cb8c38-8b94-442c-abb2-6a6542346e6f" containerName="registry"
Jul 29 19:34:34.166728 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.166547    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6cb8c38-8b94-442c-abb2-6a6542346e6f" containerName="registry"
Jul 29 19:34:34.168182 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.168166    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.170903 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.170874    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 19:34:34.171862 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.171841    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 19:34:34.171938 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.171847    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9ln5h\""
Jul 29 19:34:34.181427 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.181407    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"]
Jul 29 19:34:34.212273 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.212247    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.212440 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.212282    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.212440 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.212320    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzslb\" (UniqueName: \"kubernetes.io/projected/aada097a-1b9d-412e-a970-4ac92a12bce4-kube-api-access-nzslb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.313138 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.313101    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.313262 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.313153    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzslb\" (UniqueName: \"kubernetes.io/projected/aada097a-1b9d-412e-a970-4ac92a12bce4-kube-api-access-nzslb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.313262 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.313197    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.313513 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.313491    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.313548 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.313516    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.326191 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.326161    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzslb\" (UniqueName: \"kubernetes.io/projected/aada097a-1b9d-412e-a970-4ac92a12bce4-kube-api-access-nzslb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.477414 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.477377    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:34.604925 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:34.604897    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"]
Jul 29 19:34:34.607830 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:34:34.607797    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaada097a_1b9d_412e_a970_4ac92a12bce4.slice/crio-d85352086977f7ec03d911b04d70780c522b0d7d3d29c062b62bbe6a4db8b124 WatchSource:0}: Error finding container d85352086977f7ec03d911b04d70780c522b0d7d3d29c062b62bbe6a4db8b124: Status 404 returned error can't find the container with id d85352086977f7ec03d911b04d70780c522b0d7d3d29c062b62bbe6a4db8b124
Jul 29 19:34:35.362716 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:35.362683    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf" event={"ID":"aada097a-1b9d-412e-a970-4ac92a12bce4","Type":"ContainerStarted","Data":"d85352086977f7ec03d911b04d70780c522b0d7d3d29c062b62bbe6a4db8b124"}
Jul 29 19:34:42.386836 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:42.386733    2531 generic.go:356] "Generic (PLEG): container finished" podID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerID="2362db898008014f88144e10fae688e54bb2af9eb48b6cce9250f66e64f242de" exitCode=0
Jul 29 19:34:42.386836 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:42.386777    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf" event={"ID":"aada097a-1b9d-412e-a970-4ac92a12bce4","Type":"ContainerDied","Data":"2362db898008014f88144e10fae688e54bb2af9eb48b6cce9250f66e64f242de"}
Jul 29 19:34:45.398261 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:45.398223    2531 generic.go:356] "Generic (PLEG): container finished" podID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerID="f86cc9f05098f68ee692f2db21d8fd48c05fdce9a4e07fb7587702b7e5b86716" exitCode=0
Jul 29 19:34:45.398678 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:45.398313    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf" event={"ID":"aada097a-1b9d-412e-a970-4ac92a12bce4","Type":"ContainerDied","Data":"f86cc9f05098f68ee692f2db21d8fd48c05fdce9a4e07fb7587702b7e5b86716"}
Jul 29 19:34:53.587150 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:53.587128    2531 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 19:34:54.430203 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:54.430169    2531 generic.go:356] "Generic (PLEG): container finished" podID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerID="8327cf8b0f5df72f83ab6c01f5b3d2fa695b6892504ec9cd9cc2496fc80247cb" exitCode=0
Jul 29 19:34:54.430391 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:54.430218    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf" event={"ID":"aada097a-1b9d-412e-a970-4ac92a12bce4","Type":"ContainerDied","Data":"8327cf8b0f5df72f83ab6c01f5b3d2fa695b6892504ec9cd9cc2496fc80247cb"}
Jul 29 19:34:55.561381 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.561358    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:34:55.666339 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.666303    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-util\") pod \"aada097a-1b9d-412e-a970-4ac92a12bce4\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") "
Jul 29 19:34:55.666339 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.666348    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-bundle\") pod \"aada097a-1b9d-412e-a970-4ac92a12bce4\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") "
Jul 29 19:34:55.666524 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.666367    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzslb\" (UniqueName: \"kubernetes.io/projected/aada097a-1b9d-412e-a970-4ac92a12bce4-kube-api-access-nzslb\") pod \"aada097a-1b9d-412e-a970-4ac92a12bce4\" (UID: \"aada097a-1b9d-412e-a970-4ac92a12bce4\") "
Jul 29 19:34:55.666942 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.666920    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-bundle" (OuterVolumeSpecName: "bundle") pod "aada097a-1b9d-412e-a970-4ac92a12bce4" (UID: "aada097a-1b9d-412e-a970-4ac92a12bce4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:34:55.668659 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.668634    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aada097a-1b9d-412e-a970-4ac92a12bce4-kube-api-access-nzslb" (OuterVolumeSpecName: "kube-api-access-nzslb") pod "aada097a-1b9d-412e-a970-4ac92a12bce4" (UID: "aada097a-1b9d-412e-a970-4ac92a12bce4"). InnerVolumeSpecName "kube-api-access-nzslb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:34:55.670823 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.670805    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-util" (OuterVolumeSpecName: "util") pod "aada097a-1b9d-412e-a970-4ac92a12bce4" (UID: "aada097a-1b9d-412e-a970-4ac92a12bce4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:34:55.767272 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.767169    2531 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-util\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:34:55.767272 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.767214    2531 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aada097a-1b9d-412e-a970-4ac92a12bce4-bundle\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:34:55.767272 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:55.767229    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzslb\" (UniqueName: \"kubernetes.io/projected/aada097a-1b9d-412e-a970-4ac92a12bce4-kube-api-access-nzslb\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:34:56.442974 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:56.442942    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf" event={"ID":"aada097a-1b9d-412e-a970-4ac92a12bce4","Type":"ContainerDied","Data":"d85352086977f7ec03d911b04d70780c522b0d7d3d29c062b62bbe6a4db8b124"}
Jul 29 19:34:56.443153 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:56.442987    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d85352086977f7ec03d911b04d70780c522b0d7d3d29c062b62bbe6a4db8b124"
Jul 29 19:34:56.443153 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:34:56.442989    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kfjjf"
Jul 29 19:35:06.118244 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118211    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"]
Jul 29 19:35:06.118714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118424    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerName="util"
Jul 29 19:35:06.118714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118435    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerName="util"
Jul 29 19:35:06.118714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118447    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerName="pull"
Jul 29 19:35:06.118714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118452    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerName="pull"
Jul 29 19:35:06.118714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118459    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerName="extract"
Jul 29 19:35:06.118714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118464    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerName="extract"
Jul 29 19:35:06.118714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.118498    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="aada097a-1b9d-412e-a970-4ac92a12bce4" containerName="extract"
Jul 29 19:35:06.121799 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.121783    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.124379 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.124358    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 19:35:06.125399 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.125382    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 19:35:06.125516 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.125382    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9ln5h\""
Jul 29 19:35:06.133011 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.132991    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"]
Jul 29 19:35:06.238699 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.238663    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rn6\" (UniqueName: \"kubernetes.io/projected/2e2807fd-1f4f-47d8-96d5-9c817a4face7-kube-api-access-c5rn6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.238862 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.238707    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.238862 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.238733    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.339631 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.339603    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rn6\" (UniqueName: \"kubernetes.io/projected/2e2807fd-1f4f-47d8-96d5-9c817a4face7-kube-api-access-c5rn6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.339733 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.339639    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.339733 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.339656    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.340009 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.339992    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.340106 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.340022    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.350605 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.350586    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rn6\" (UniqueName: \"kubernetes.io/projected/2e2807fd-1f4f-47d8-96d5-9c817a4face7-kube-api-access-c5rn6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.430720 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.430638    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:06.560550 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:06.560514    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"]
Jul 29 19:35:06.564351 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:35:06.564321    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2807fd_1f4f_47d8_96d5_9c817a4face7.slice/crio-5a4e1f3e7dd0c919b4ff8d7ac4b0faef5f844727c20cb4b60c42d6be3701a42f WatchSource:0}: Error finding container 5a4e1f3e7dd0c919b4ff8d7ac4b0faef5f844727c20cb4b60c42d6be3701a42f: Status 404 returned error can't find the container with id 5a4e1f3e7dd0c919b4ff8d7ac4b0faef5f844727c20cb4b60c42d6be3701a42f
Jul 29 19:35:07.478930 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:07.478896    2531 generic.go:356] "Generic (PLEG): container finished" podID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerID="f07e4aabf1da42fc55b213b722951e8422d86cfec38e73fc22fcc36863cd0ee5" exitCode=0
Jul 29 19:35:07.479325 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:07.478955    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42" event={"ID":"2e2807fd-1f4f-47d8-96d5-9c817a4face7","Type":"ContainerDied","Data":"f07e4aabf1da42fc55b213b722951e8422d86cfec38e73fc22fcc36863cd0ee5"}
Jul 29 19:35:07.479325 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:07.478990    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42" event={"ID":"2e2807fd-1f4f-47d8-96d5-9c817a4face7","Type":"ContainerStarted","Data":"5a4e1f3e7dd0c919b4ff8d7ac4b0faef5f844727c20cb4b60c42d6be3701a42f"}
Jul 29 19:35:07.479866 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:07.479851    2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:35:08.897833 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:08.897800    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"]
Jul 29 19:35:08.902966 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:08.902935    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:08.905426 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:08.905403    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 19:35:08.905942 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:08.905922    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 19:35:08.906070 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:08.905922    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nxfhw\""
Jul 29 19:35:08.912478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:08.912457    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"]
Jul 29 19:35:09.062626 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.062594    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fecaa7e9-7032-4f69-b28a-176417f0c542-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gjvpb\" (UID: \"fecaa7e9-7032-4f69-b28a-176417f0c542\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:09.062792 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.062643    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4bd\" (UniqueName: \"kubernetes.io/projected/fecaa7e9-7032-4f69-b28a-176417f0c542-kube-api-access-mz4bd\") pod \"cert-manager-cainjector-559cdd8c87-gjvpb\" (UID: \"fecaa7e9-7032-4f69-b28a-176417f0c542\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:09.163113 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.163026    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fecaa7e9-7032-4f69-b28a-176417f0c542-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gjvpb\" (UID: \"fecaa7e9-7032-4f69-b28a-176417f0c542\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:09.163113 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.163100    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4bd\" (UniqueName: \"kubernetes.io/projected/fecaa7e9-7032-4f69-b28a-176417f0c542-kube-api-access-mz4bd\") pod \"cert-manager-cainjector-559cdd8c87-gjvpb\" (UID: \"fecaa7e9-7032-4f69-b28a-176417f0c542\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:09.173001 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.172971    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fecaa7e9-7032-4f69-b28a-176417f0c542-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gjvpb\" (UID: \"fecaa7e9-7032-4f69-b28a-176417f0c542\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:09.173176 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.173088    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4bd\" (UniqueName: \"kubernetes.io/projected/fecaa7e9-7032-4f69-b28a-176417f0c542-kube-api-access-mz4bd\") pod \"cert-manager-cainjector-559cdd8c87-gjvpb\" (UID: \"fecaa7e9-7032-4f69-b28a-176417f0c542\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:09.213394 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.213368    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"
Jul 29 19:35:09.849307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:09.849269    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb"]
Jul 29 19:35:09.853423 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:35:09.853396    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfecaa7e9_7032_4f69_b28a_176417f0c542.slice/crio-a5ce4f1f6bbbbadd8003921a4af8fc2b93359d0423b9970fac552f81fea81baa WatchSource:0}: Error finding container a5ce4f1f6bbbbadd8003921a4af8fc2b93359d0423b9970fac552f81fea81baa: Status 404 returned error can't find the container with id a5ce4f1f6bbbbadd8003921a4af8fc2b93359d0423b9970fac552f81fea81baa
Jul 29 19:35:10.490375 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:10.490341    2531 generic.go:356] "Generic (PLEG): container finished" podID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerID="6caf388aa40bb50182b42740922684de19aea501ead90ffb529fb9b24e80f6d1" exitCode=0
Jul 29 19:35:10.490838 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:10.490427    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42" event={"ID":"2e2807fd-1f4f-47d8-96d5-9c817a4face7","Type":"ContainerDied","Data":"6caf388aa40bb50182b42740922684de19aea501ead90ffb529fb9b24e80f6d1"}
Jul 29 19:35:10.491581 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:10.491562    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb" event={"ID":"fecaa7e9-7032-4f69-b28a-176417f0c542","Type":"ContainerStarted","Data":"a5ce4f1f6bbbbadd8003921a4af8fc2b93359d0423b9970fac552f81fea81baa"}
Jul 29 19:35:11.497779 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:11.497745    2531 generic.go:356] "Generic (PLEG): container finished" podID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerID="9584e9797469b5bdf28abb97922fb4a63d9d66ca2a51fb845a97343176104a76" exitCode=0
Jul 29 19:35:11.498212 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:11.497811    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42" event={"ID":"2e2807fd-1f4f-47d8-96d5-9c817a4face7","Type":"ContainerDied","Data":"9584e9797469b5bdf28abb97922fb4a63d9d66ca2a51fb845a97343176104a76"}
Jul 29 19:35:12.655023 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.655006    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:12.790644 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.790551    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5rn6\" (UniqueName: \"kubernetes.io/projected/2e2807fd-1f4f-47d8-96d5-9c817a4face7-kube-api-access-c5rn6\") pod \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") "
Jul 29 19:35:12.790807 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.790667    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-bundle\") pod \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") "
Jul 29 19:35:12.790807 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.790709    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-util\") pod \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\" (UID: \"2e2807fd-1f4f-47d8-96d5-9c817a4face7\") "
Jul 29 19:35:12.791235 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.791208    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-bundle" (OuterVolumeSpecName: "bundle") pod "2e2807fd-1f4f-47d8-96d5-9c817a4face7" (UID: "2e2807fd-1f4f-47d8-96d5-9c817a4face7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:35:12.792992 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.792969    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2807fd-1f4f-47d8-96d5-9c817a4face7-kube-api-access-c5rn6" (OuterVolumeSpecName: "kube-api-access-c5rn6") pod "2e2807fd-1f4f-47d8-96d5-9c817a4face7" (UID: "2e2807fd-1f4f-47d8-96d5-9c817a4face7"). InnerVolumeSpecName "kube-api-access-c5rn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:35:12.797080 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.797038    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-util" (OuterVolumeSpecName: "util") pod "2e2807fd-1f4f-47d8-96d5-9c817a4face7" (UID: "2e2807fd-1f4f-47d8-96d5-9c817a4face7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:35:12.891528 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.891491    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5rn6\" (UniqueName: \"kubernetes.io/projected/2e2807fd-1f4f-47d8-96d5-9c817a4face7-kube-api-access-c5rn6\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:35:12.891528 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.891519    2531 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-bundle\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:35:12.891528 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:12.891531    2531 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e2807fd-1f4f-47d8-96d5-9c817a4face7-util\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:35:13.506970 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:13.506943    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42"
Jul 29 19:35:13.507181 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:13.506924    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frxs42" event={"ID":"2e2807fd-1f4f-47d8-96d5-9c817a4face7","Type":"ContainerDied","Data":"5a4e1f3e7dd0c919b4ff8d7ac4b0faef5f844727c20cb4b60c42d6be3701a42f"}
Jul 29 19:35:13.507181 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:13.507106    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a4e1f3e7dd0c919b4ff8d7ac4b0faef5f844727c20cb4b60c42d6be3701a42f"
Jul 29 19:35:13.508428 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:13.508396    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb" event={"ID":"fecaa7e9-7032-4f69-b28a-176417f0c542","Type":"ContainerStarted","Data":"b080db12d87fac4f8761ece3bb752cdbb563d47280dbeabcf5b85aa7b07a1998"}
Jul 29 19:35:13.531943 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:13.531897    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gjvpb" podStartSLOduration=2.738715713 podStartE2EDuration="5.531879075s" totalImagesPullingTime="2.793163362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:35:13.531676178 +0000 UTC m=+321.685934801" watchObservedRunningTime="2026-07-29 19:35:13.531879075 +0000 UTC m=+321.686137700"
Jul 29 19:35:27.071927 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.071886    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"]
Jul 29 19:35:27.072440 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.072417    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerName="util"
Jul 29 19:35:27.072440 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.072435    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerName="util"
Jul 29 19:35:27.072534 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.072446    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerName="extract"
Jul 29 19:35:27.072534 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.072454    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerName="extract"
Jul 29 19:35:27.072534 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.072468    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerName="pull"
Jul 29 19:35:27.072534 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.072483    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerName="pull"
Jul 29 19:35:27.072705 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.072583    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2807fd-1f4f-47d8-96d5-9c817a4face7" containerName="extract"
Jul 29 19:35:27.087877 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.087853    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"]
Jul 29 19:35:27.088031 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.087943    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.090773 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.090753    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 19:35:27.090902 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.090820    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 19:35:27.090902 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.090825    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9ln5h\""
Jul 29 19:35:27.192262 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.192234    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfv4b\" (UniqueName: \"kubernetes.io/projected/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-kube-api-access-pfv4b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.192412 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.192278    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.192412 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.192372    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.293556 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.293523    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfv4b\" (UniqueName: \"kubernetes.io/projected/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-kube-api-access-pfv4b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.293702 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.293566    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.293702 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.293601    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.293913 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.293897    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.293977 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.293958    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.302971 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.302943    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfv4b\" (UniqueName: \"kubernetes.io/projected/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-kube-api-access-pfv4b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.397393 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.397316    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:27.533121 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.533091    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"]
Jul 29 19:35:27.535947 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:35:27.535912    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda19bb78_2e7e_4bcd_ae5e_5d8cecacf35b.slice/crio-ab05dec079626074fa30ad29595aa07a231b002db9d0ce0c15989a9b4e856dd1 WatchSource:0}: Error finding container ab05dec079626074fa30ad29595aa07a231b002db9d0ce0c15989a9b4e856dd1: Status 404 returned error can't find the container with id ab05dec079626074fa30ad29595aa07a231b002db9d0ce0c15989a9b4e856dd1
Jul 29 19:35:27.556986 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:27.556962    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj" event={"ID":"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b","Type":"ContainerStarted","Data":"ab05dec079626074fa30ad29595aa07a231b002db9d0ce0c15989a9b4e856dd1"}
Jul 29 19:35:28.561983 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:28.561904    2531 generic.go:356] "Generic (PLEG): container finished" podID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerID="7f2acbcfab876e9fe6a33c77c467c376cce4678cc199c3b9671b0fdf9374a206" exitCode=0
Jul 29 19:35:28.561983 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:28.561939    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj" event={"ID":"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b","Type":"ContainerDied","Data":"7f2acbcfab876e9fe6a33c77c467c376cce4678cc199c3b9671b0fdf9374a206"}
Jul 29 19:35:29.566439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:29.566405    2531 generic.go:356] "Generic (PLEG): container finished" podID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerID="71dbec2b211bf04ffe279552a2bf7c99649a23ae7d73ca004d4488c79aac5c9c" exitCode=0
Jul 29 19:35:29.566883 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:29.566495    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj" event={"ID":"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b","Type":"ContainerDied","Data":"71dbec2b211bf04ffe279552a2bf7c99649a23ae7d73ca004d4488c79aac5c9c"}
Jul 29 19:35:30.572521 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:30.572488    2531 generic.go:356] "Generic (PLEG): container finished" podID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerID="5a3f4182e76ddac2198429d66cc97ce113f0f9812dfe2f69c7cf9963a7a8a020" exitCode=0
Jul 29 19:35:30.572940 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:30.572547    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj" event={"ID":"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b","Type":"ContainerDied","Data":"5a3f4182e76ddac2198429d66cc97ce113f0f9812dfe2f69c7cf9963a7a8a020"}
Jul 29 19:35:31.701840 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.701818    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:31.827614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.827525    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-bundle\") pod \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") "
Jul 29 19:35:31.827614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.827584    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfv4b\" (UniqueName: \"kubernetes.io/projected/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-kube-api-access-pfv4b\") pod \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") "
Jul 29 19:35:31.827614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.827611    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-util\") pod \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\" (UID: \"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b\") "
Jul 29 19:35:31.828330 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.828294    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-bundle" (OuterVolumeSpecName: "bundle") pod "da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" (UID: "da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:35:31.829848 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.829817    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-kube-api-access-pfv4b" (OuterVolumeSpecName: "kube-api-access-pfv4b") pod "da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" (UID: "da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b"). InnerVolumeSpecName "kube-api-access-pfv4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:35:31.833620 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.833592    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-util" (OuterVolumeSpecName: "util") pod "da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" (UID: "da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:35:31.928878 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.928843    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfv4b\" (UniqueName: \"kubernetes.io/projected/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-kube-api-access-pfv4b\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:35:31.928878 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.928873    2531 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-util\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:35:31.928878 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:31.928884    2531 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b-bundle\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:35:32.580829 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:32.580802    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj"
Jul 29 19:35:32.580829 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:32.580819    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5vjfj" event={"ID":"da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b","Type":"ContainerDied","Data":"ab05dec079626074fa30ad29595aa07a231b002db9d0ce0c15989a9b4e856dd1"}
Jul 29 19:35:32.581015 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:32.580861    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab05dec079626074fa30ad29595aa07a231b002db9d0ce0c15989a9b4e856dd1"
Jul 29 19:35:39.792648 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792614    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"]
Jul 29 19:35:39.793131 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792869    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerName="util"
Jul 29 19:35:39.793131 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792880    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerName="util"
Jul 29 19:35:39.793131 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792891    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerName="pull"
Jul 29 19:35:39.793131 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792897    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerName="pull"
Jul 29 19:35:39.793131 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792903    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerName="extract"
Jul 29 19:35:39.793131 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792908    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerName="extract"
Jul 29 19:35:39.793131 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.792957    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="da19bb78-2e7e-4bcd-ae5e-5d8cecacf35b" containerName="extract"
Jul 29 19:35:39.798690 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.798673    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.801614 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.801591    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 19:35:39.801787 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.801617    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 19:35:39.801871 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.801690    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2vqxw\""
Jul 29 19:35:39.801871 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.801840    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 19:35:39.802143 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.802124    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 19:35:39.810017 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.809995    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"]
Jul 29 19:35:39.877790 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.877759    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8fb359f4-d7d1-4468-bdda-2e7a01f08538-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.877939 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.877800    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fb359f4-d7d1-4468-bdda-2e7a01f08538-tmp\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.877939 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.877826    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8fb359f4-d7d1-4468-bdda-2e7a01f08538-manifests\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.877939 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.877890    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fb359f4-d7d1-4468-bdda-2e7a01f08538-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.877939 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.877918    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvsbc\" (UniqueName: \"kubernetes.io/projected/8fb359f4-d7d1-4468-bdda-2e7a01f08538-kube-api-access-kvsbc\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.978376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.978351    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fb359f4-d7d1-4468-bdda-2e7a01f08538-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.978546 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.978382    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvsbc\" (UniqueName: \"kubernetes.io/projected/8fb359f4-d7d1-4468-bdda-2e7a01f08538-kube-api-access-kvsbc\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.978546 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.978413    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8fb359f4-d7d1-4468-bdda-2e7a01f08538-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.978660 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.978542    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fb359f4-d7d1-4468-bdda-2e7a01f08538-tmp\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.978660 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.978580    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8fb359f4-d7d1-4468-bdda-2e7a01f08538-manifests\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.978958 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.978938    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8fb359f4-d7d1-4468-bdda-2e7a01f08538-manifests\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.980805 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.980784    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fb359f4-d7d1-4468-bdda-2e7a01f08538-tmp\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.980927 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.980908    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8fb359f4-d7d1-4468-bdda-2e7a01f08538-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.981096 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.981078    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8fb359f4-d7d1-4468-bdda-2e7a01f08538-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:39.993042 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:39.993021    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvsbc\" (UniqueName: \"kubernetes.io/projected/8fb359f4-d7d1-4468-bdda-2e7a01f08538-kube-api-access-kvsbc\") pod \"opendatahub-operator-controller-manager-5d75b7b96-vhrgv\" (UID: \"8fb359f4-d7d1-4468-bdda-2e7a01f08538\") " pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:40.108743 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:40.108653    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:40.242267 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:40.242230    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"]
Jul 29 19:35:40.244987 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:35:40.244960    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb359f4_d7d1_4468_bdda_2e7a01f08538.slice/crio-9ec18083ac870465d9ea30c39478fc714d04eee5d56465350ad04b4611d4cc59 WatchSource:0}: Error finding container 9ec18083ac870465d9ea30c39478fc714d04eee5d56465350ad04b4611d4cc59: Status 404 returned error can't find the container with id 9ec18083ac870465d9ea30c39478fc714d04eee5d56465350ad04b4611d4cc59
Jul 29 19:35:40.614248 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:40.614212    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv" event={"ID":"8fb359f4-d7d1-4468-bdda-2e7a01f08538","Type":"ContainerStarted","Data":"9ec18083ac870465d9ea30c39478fc714d04eee5d56465350ad04b4611d4cc59"}
Jul 29 19:35:43.628880 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:43.628796    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv" event={"ID":"8fb359f4-d7d1-4468-bdda-2e7a01f08538","Type":"ContainerStarted","Data":"8fbc7eeacbfae522eb1e71d18d46726f2e20f2b68227427fa3e09987d8706d4a"}
Jul 29 19:35:44.633601 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:44.633509    2531 generic.go:356] "Generic (PLEG): container finished" podID="8fb359f4-d7d1-4468-bdda-2e7a01f08538" containerID="8fbc7eeacbfae522eb1e71d18d46726f2e20f2b68227427fa3e09987d8706d4a" exitCode=0
Jul 29 19:35:44.633601 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:44.633575    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv" event={"ID":"8fb359f4-d7d1-4468-bdda-2e7a01f08538","Type":"ContainerDied","Data":"8fbc7eeacbfae522eb1e71d18d46726f2e20f2b68227427fa3e09987d8706d4a"}
Jul 29 19:35:45.639200 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:45.639166    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv" event={"ID":"8fb359f4-d7d1-4468-bdda-2e7a01f08538","Type":"ContainerStarted","Data":"697ed1ad2d36a642feb9502990df5cdb23ec8e703512750f8c995ab910905af5"}
Jul 29 19:35:45.639569 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:45.639291    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:45.665826 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:45.665780    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv" podStartSLOduration=2.269245123 podStartE2EDuration="6.66576732s" totalImagesPullingTime="3.392712364s" totalInitContainerRuntime="1.003809833s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:35:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:35:45.663536213 +0000 UTC m=+353.817794834" watchObservedRunningTime="2026-07-29 19:35:45.66576732 +0000 UTC m=+353.820025938"
Jul 29 19:35:56.644834 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:56.644802    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d75b7b96-vhrgv"
Jul 29 19:35:58.560385 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.560349    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"]
Jul 29 19:35:58.569026 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.569003    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.571824 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.571801    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 19:35:58.572072 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.572028    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 19:35:58.572853 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.572833    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 19:35:58.572979 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.572922    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 19:35:58.573104 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.572997    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bnvdj\""
Jul 29 19:35:58.573286 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.573270    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 19:35:58.574833 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.574812    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"]
Jul 29 19:35:58.598358 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.598334    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-cert\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.598482 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.598371    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96dz9\" (UniqueName: \"kubernetes.io/projected/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-kube-api-access-96dz9\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.598482 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.598438    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-manager-config\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.598602 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.598483    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-metrics-cert\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.699587 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.699558    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-metrics-cert\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.699751 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.699595    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-cert\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.699751 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.699620    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96dz9\" (UniqueName: \"kubernetes.io/projected/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-kube-api-access-96dz9\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.699751 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.699667    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-manager-config\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.700373 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.700349    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-manager-config\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.702179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.702161    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-cert\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.702387 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.702367    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-metrics-cert\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.708981 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.708963    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96dz9\" (UniqueName: \"kubernetes.io/projected/c40d7206-03da-4fbe-8f6b-eb15ee7ea891-kube-api-access-96dz9\") pod \"lws-controller-manager-fcbbc6665-gd98b\" (UID: \"c40d7206-03da-4fbe-8f6b-eb15ee7ea891\") " pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:58.879254 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:58.879161    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:35:59.017331 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:59.017305    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"]
Jul 29 19:35:59.019513 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:35:59.019487    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40d7206_03da_4fbe_8f6b_eb15ee7ea891.slice/crio-07c0ffe2185d021e059e21adbeda688c442bde83d91307871dbbe9478e44c2de WatchSource:0}: Error finding container 07c0ffe2185d021e059e21adbeda688c442bde83d91307871dbbe9478e44c2de: Status 404 returned error can't find the container with id 07c0ffe2185d021e059e21adbeda688c442bde83d91307871dbbe9478e44c2de
Jul 29 19:35:59.687863 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:35:59.687829    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b" event={"ID":"c40d7206-03da-4fbe-8f6b-eb15ee7ea891","Type":"ContainerStarted","Data":"07c0ffe2185d021e059e21adbeda688c442bde83d91307871dbbe9478e44c2de"}
Jul 29 19:36:01.248802 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.248767    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vh6td"]
Jul 29 19:36:01.252850 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.252831    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:01.255651 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.255633    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 19:36:01.270871 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.270829    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vh6td"]
Jul 29 19:36:01.323586 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.323555    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvx4w\" (UniqueName: \"kubernetes.io/projected/4b9f7dc5-5554-4582-890b-b6b01b2f9110-kube-api-access-wvx4w\") pod \"model-serving-api-54d89bd5fc-vh6td\" (UID: \"4b9f7dc5-5554-4582-890b-b6b01b2f9110\") " pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:01.323744 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.323597    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9f7dc5-5554-4582-890b-b6b01b2f9110-tls-certs\") pod \"model-serving-api-54d89bd5fc-vh6td\" (UID: \"4b9f7dc5-5554-4582-890b-b6b01b2f9110\") " pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:01.424188 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.424152    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvx4w\" (UniqueName: \"kubernetes.io/projected/4b9f7dc5-5554-4582-890b-b6b01b2f9110-kube-api-access-wvx4w\") pod \"model-serving-api-54d89bd5fc-vh6td\" (UID: \"4b9f7dc5-5554-4582-890b-b6b01b2f9110\") " pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:01.424188 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.424193    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9f7dc5-5554-4582-890b-b6b01b2f9110-tls-certs\") pod \"model-serving-api-54d89bd5fc-vh6td\" (UID: \"4b9f7dc5-5554-4582-890b-b6b01b2f9110\") " pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:01.424410 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:36:01.424314    2531 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 29 19:36:01.424410 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:36:01.424382    2531 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f7dc5-5554-4582-890b-b6b01b2f9110-tls-certs podName:4b9f7dc5-5554-4582-890b-b6b01b2f9110 nodeName:}" failed. No retries permitted until 2026-07-29 19:36:01.924366661 +0000 UTC m=+370.078625259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4b9f7dc5-5554-4582-890b-b6b01b2f9110-tls-certs") pod "model-serving-api-54d89bd5fc-vh6td" (UID: "4b9f7dc5-5554-4582-890b-b6b01b2f9110") : secret "model-serving-api-tls" not found
Jul 29 19:36:01.433289 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.433262    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvx4w\" (UniqueName: \"kubernetes.io/projected/4b9f7dc5-5554-4582-890b-b6b01b2f9110-kube-api-access-wvx4w\") pod \"model-serving-api-54d89bd5fc-vh6td\" (UID: \"4b9f7dc5-5554-4582-890b-b6b01b2f9110\") " pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:01.698433 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.698398    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b" event={"ID":"c40d7206-03da-4fbe-8f6b-eb15ee7ea891","Type":"ContainerStarted","Data":"29e3af35573b282d4668d385cd244723758f6d4c713e0902e4795d153d3f266c"}
Jul 29 19:36:01.698633 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.698476    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:36:01.718006 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.717957    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b" podStartSLOduration=1.955806514 podStartE2EDuration="3.717940452s" totalImagesPullingTime="1.762133938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:36:01.716823814 +0000 UTC m=+369.871082433" watchObservedRunningTime="2026-07-29 19:36:01.717940452 +0000 UTC m=+369.872199139"
Jul 29 19:36:01.927358 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.927253    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9f7dc5-5554-4582-890b-b6b01b2f9110-tls-certs\") pod \"model-serving-api-54d89bd5fc-vh6td\" (UID: \"4b9f7dc5-5554-4582-890b-b6b01b2f9110\") " pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:01.929779 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:01.929759    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b9f7dc5-5554-4582-890b-b6b01b2f9110-tls-certs\") pod \"model-serving-api-54d89bd5fc-vh6td\" (UID: \"4b9f7dc5-5554-4582-890b-b6b01b2f9110\") " pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:02.161799 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:02.161707    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:02.301633 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:02.301528    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vh6td"]
Jul 29 19:36:02.303808 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:36:02.303774    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9f7dc5_5554_4582_890b_b6b01b2f9110.slice/crio-4da7d1a9a3785325d6081f414cc7c3b4aeaa58b0a2dc68c98aeed068d31c0155 WatchSource:0}: Error finding container 4da7d1a9a3785325d6081f414cc7c3b4aeaa58b0a2dc68c98aeed068d31c0155: Status 404 returned error can't find the container with id 4da7d1a9a3785325d6081f414cc7c3b4aeaa58b0a2dc68c98aeed068d31c0155
Jul 29 19:36:02.703657 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:02.703604    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vh6td" event={"ID":"4b9f7dc5-5554-4582-890b-b6b01b2f9110","Type":"ContainerStarted","Data":"4da7d1a9a3785325d6081f414cc7c3b4aeaa58b0a2dc68c98aeed068d31c0155"}
Jul 29 19:36:04.714170 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:04.714136    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vh6td" event={"ID":"4b9f7dc5-5554-4582-890b-b6b01b2f9110","Type":"ContainerStarted","Data":"fca8c26965f444ab910a21eae8e140f4e422efcf3c4ebafa6ec3f6bc8315326b"}
Jul 29 19:36:04.714577 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:04.714281    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:36:04.740992 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:04.740947    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vh6td" podStartSLOduration=1.966486148 podStartE2EDuration="3.740931762s" totalImagesPullingTime="1.774445614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:36:04.739708954 +0000 UTC m=+372.893967585" watchObservedRunningTime="2026-07-29 19:36:04.740931762 +0000 UTC m=+372.895190384"
Jul 29 19:36:07.075992 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.075959    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"]
Jul 29 19:36:07.079096 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.079079    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.081877 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.081856    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 19:36:07.082139 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.082122    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 19:36:07.082234 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.082210    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 19:36:07.082318 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.082300    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-55wvn\""
Jul 29 19:36:07.093552 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.093530    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"]
Jul 29 19:36:07.167789 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167759    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.167964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167804    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwrl7\" (UniqueName: \"kubernetes.io/projected/ef7583ea-3184-45fc-acb5-2002cb10d3d7-kube-api-access-hwrl7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.167964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167834    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.167964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167858    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.167964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167881    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.167964 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167913    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.168153 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167961    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.168153 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.167998    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.168153 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.168017    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268728 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268694    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwrl7\" (UniqueName: \"kubernetes.io/projected/ef7583ea-3184-45fc-acb5-2002cb10d3d7-kube-api-access-hwrl7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268728 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268732    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268760    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268798    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268832    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268861    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268886    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268909    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.268969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.268958    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.269350 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.269211    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.269424 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.269401    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.269471 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.269424    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.269511 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.269467    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.269646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.269626    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.271952 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.271932    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.272139 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.272123    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.278257 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.278233    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7583ea-3184-45fc-acb5-2002cb10d3d7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.278891 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.278870    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwrl7\" (UniqueName: \"kubernetes.io/projected/ef7583ea-3184-45fc-acb5-2002cb10d3d7-kube-api-access-hwrl7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g\" (UID: \"ef7583ea-3184-45fc-acb5-2002cb10d3d7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.388899 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.388808    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:07.538307 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.538279    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"]
Jul 29 19:36:07.540694 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:36:07.540658    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7583ea_3184_45fc_acb5_2002cb10d3d7.slice/crio-0f5fa4096d122c6d27ba0e089b3e85afea326ec775844d24f4f2742602ed26e7 WatchSource:0}: Error finding container 0f5fa4096d122c6d27ba0e089b3e85afea326ec775844d24f4f2742602ed26e7: Status 404 returned error can't find the container with id 0f5fa4096d122c6d27ba0e089b3e85afea326ec775844d24f4f2742602ed26e7
Jul 29 19:36:07.715127 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.715095    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"]
Jul 29 19:36:07.719544 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.719528    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.722322 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.722297    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 19:36:07.722322 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.722310    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 19:36:07.722501 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.722364    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kgj7d\""
Jul 29 19:36:07.722501 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.722297    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 19:36:07.729781 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.729729    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g" event={"ID":"ef7583ea-3184-45fc-acb5-2002cb10d3d7","Type":"ContainerStarted","Data":"0f5fa4096d122c6d27ba0e089b3e85afea326ec775844d24f4f2742602ed26e7"}
Jul 29 19:36:07.732309 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.732289    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"]
Jul 29 19:36:07.773434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.773400    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.773434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.773439    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.773621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.773463    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.773621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.773508    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a65cb93-4f0b-4455-8880-3b06aad492e0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.773621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.773530    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.773621 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.773543    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.773827 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.773624    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hzlc\" (UniqueName: \"kubernetes.io/projected/3a65cb93-4f0b-4455-8880-3b06aad492e0-kube-api-access-7hzlc\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.874700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.874660    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hzlc\" (UniqueName: \"kubernetes.io/projected/3a65cb93-4f0b-4455-8880-3b06aad492e0-kube-api-access-7hzlc\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.874897 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.874730    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.874897 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.874768    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.874897 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.874800    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.874897 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.874828    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a65cb93-4f0b-4455-8880-3b06aad492e0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.874897 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.874858    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.874897 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.874881    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.875716 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.875636    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.877515 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.877487    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.877515 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.877496    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a65cb93-4f0b-4455-8880-3b06aad492e0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.877656 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.877559    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.877656 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.877637    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.884863 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.884842    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a65cb93-4f0b-4455-8880-3b06aad492e0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:07.885186 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:07.885170    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hzlc\" (UniqueName: \"kubernetes.io/projected/3a65cb93-4f0b-4455-8880-3b06aad492e0-kube-api-access-7hzlc\") pod \"istiod-openshift-gateway-5677ccb49b-vkl2t\" (UID: \"3a65cb93-4f0b-4455-8880-3b06aad492e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:08.032158 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:08.032073    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:08.179900 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:08.179829    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"]
Jul 29 19:36:08.184183 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:36:08.184158    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a65cb93_4f0b_4455_8880_3b06aad492e0.slice/crio-cdb1948d607483869c712fda66754af5a537f4fa9dc41f5e0969c4df45b342b5 WatchSource:0}: Error finding container cdb1948d607483869c712fda66754af5a537f4fa9dc41f5e0969c4df45b342b5: Status 404 returned error can't find the container with id cdb1948d607483869c712fda66754af5a537f4fa9dc41f5e0969c4df45b342b5
Jul 29 19:36:08.737236 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:08.737200    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t" event={"ID":"3a65cb93-4f0b-4455-8880-3b06aad492e0","Type":"ContainerStarted","Data":"cdb1948d607483869c712fda66754af5a537f4fa9dc41f5e0969c4df45b342b5"}
Jul 29 19:36:11.764751 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:11.764707    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:36:11.765144 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:11.764804    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:36:11.765144 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:11.764852    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:36:11.765450 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:11.765422    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:36:11.765488 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:11.765478    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:36:12.705631 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:12.705598    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fcbbc6665-gd98b"
Jul 29 19:36:12.765975 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:12.765940    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t" event={"ID":"3a65cb93-4f0b-4455-8880-3b06aad492e0","Type":"ContainerStarted","Data":"dce2b3d5a41ef899a5d7557940f772acab175077a6eb5bfd63ea75a6e49f79c6"}
Jul 29 19:36:12.766439 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:12.766000    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:12.767714 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:12.767684    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g" event={"ID":"ef7583ea-3184-45fc-acb5-2002cb10d3d7","Type":"ContainerStarted","Data":"2a6ba065538b2cbee1bd9102ca90d9d74918966faf2b531388d36117bc732703"}
Jul 29 19:36:12.768124 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:12.768104    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t"
Jul 29 19:36:12.788194 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:12.788146    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vkl2t" podStartSLOduration=2.209062078 podStartE2EDuration="5.788130605s" totalImagesPullingTime="3.579068527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:36:12.786135329 +0000 UTC m=+380.940393948" watchObservedRunningTime="2026-07-29 19:36:12.788130605 +0000 UTC m=+380.942389223"
Jul 29 19:36:12.835462 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:12.835415    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g" podStartSLOduration=1.613524533 podStartE2EDuration="5.835399278s" totalImagesPullingTime="4.221874745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:36:12.834007126 +0000 UTC m=+380.988265745" watchObservedRunningTime="2026-07-29 19:36:12.835399278 +0000 UTC m=+380.989657897"
Jul 29 19:36:13.389769 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:13.389733    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:13.398797 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:13.394861    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:13.772080 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:13.772027    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:13.772944 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:13.772925    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g"
Jul 29 19:36:15.722787 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:36:15.722760    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vh6td"
Jul 29 19:37:16.721472 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.721394    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"]
Jul 29 19:37:16.724489 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.724470    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.727286 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.727265    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 19:37:16.727387 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.727295    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 19:37:16.728489 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.728471    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-h7xjc\""
Jul 29 19:37:16.733771 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.733752    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"]
Jul 29 19:37:16.817779 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.817748    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crc4j\" (UniqueName: \"kubernetes.io/projected/9fa136d3-2961-471f-a61a-2430f256969b-kube-api-access-crc4j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.817946 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.817789    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.817946 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.817813    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.919254 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.919224    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crc4j\" (UniqueName: \"kubernetes.io/projected/9fa136d3-2961-471f-a61a-2430f256969b-kube-api-access-crc4j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.919434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.919267    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.919434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.919293    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.919604 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.919586    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.919662 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.919619    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:16.929598 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:16.929575    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crc4j\" (UniqueName: \"kubernetes.io/projected/9fa136d3-2961-471f-a61a-2430f256969b-kube-api-access-crc4j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:17.034367 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.034293    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:17.164180 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.164151    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"]
Jul 29 19:37:17.166266 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:37:17.166241    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa136d3_2961_471f_a61a_2430f256969b.slice/crio-0e407cfebf3ba944204623c0d68dbcac184bf5048649fb918aa7c9f3186ca4a5 WatchSource:0}: Error finding container 0e407cfebf3ba944204623c0d68dbcac184bf5048649fb918aa7c9f3186ca4a5: Status 404 returned error can't find the container with id 0e407cfebf3ba944204623c0d68dbcac184bf5048649fb918aa7c9f3186ca4a5
Jul 29 19:37:17.533899 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.533866    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"]
Jul 29 19:37:17.536967 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.536948    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.545545 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.545522    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"]
Jul 29 19:37:17.625257 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.625225    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.625257 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.625259    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f58xt\" (UniqueName: \"kubernetes.io/projected/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-kube-api-access-f58xt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.625456 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.625294    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.726005 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.725960    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.726005 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.726008    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f58xt\" (UniqueName: \"kubernetes.io/projected/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-kube-api-access-f58xt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.726509 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.726043    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.726509 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.726461    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.726509 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.726468    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.736062 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.736025    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f58xt\" (UniqueName: \"kubernetes.io/projected/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-kube-api-access-f58xt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.846209 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.846131    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:17.974119 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:17.974093    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"]
Jul 29 19:37:17.976550 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:37:17.976523    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d83a104_6ee8_44a6_bd0e_6abf70c065e1.slice/crio-08ea6ccd6189214001274f4950c283cb771c766596662aecc3a0c099bebd38c1 WatchSource:0}: Error finding container 08ea6ccd6189214001274f4950c283cb771c766596662aecc3a0c099bebd38c1: Status 404 returned error can't find the container with id 08ea6ccd6189214001274f4950c283cb771c766596662aecc3a0c099bebd38c1
Jul 29 19:37:18.048297 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.048262    2531 generic.go:356] "Generic (PLEG): container finished" podID="9fa136d3-2961-471f-a61a-2430f256969b" containerID="ac3f672cafea6ecb9e6670565e2f39023d9f33d52c9253ed4332b6426c1bc16c" exitCode=0
Jul 29 19:37:18.048458 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.048342    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9" event={"ID":"9fa136d3-2961-471f-a61a-2430f256969b","Type":"ContainerDied","Data":"ac3f672cafea6ecb9e6670565e2f39023d9f33d52c9253ed4332b6426c1bc16c"}
Jul 29 19:37:18.048458 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.048393    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9" event={"ID":"9fa136d3-2961-471f-a61a-2430f256969b","Type":"ContainerStarted","Data":"0e407cfebf3ba944204623c0d68dbcac184bf5048649fb918aa7c9f3186ca4a5"}
Jul 29 19:37:18.050048 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.050027    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq" event={"ID":"0d83a104-6ee8-44a6-bd0e-6abf70c065e1","Type":"ContainerStarted","Data":"7ac53d87caa7d2abac1ab600b3997b2c0d1565708025ed792be62e747dca511e"}
Jul 29 19:37:18.050156 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.050092    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq" event={"ID":"0d83a104-6ee8-44a6-bd0e-6abf70c065e1","Type":"ContainerStarted","Data":"08ea6ccd6189214001274f4950c283cb771c766596662aecc3a0c099bebd38c1"}
Jul 29 19:37:18.124985 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.124910    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"]
Jul 29 19:37:18.128170 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.128155    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.137109 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.137045    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"]
Jul 29 19:37:18.230201 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.230165    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.230201 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.230206    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwpm\" (UniqueName: \"kubernetes.io/projected/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-kube-api-access-ghwpm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.230417 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.230222    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.330911 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.330873    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.331122 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.330921    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwpm\" (UniqueName: \"kubernetes.io/projected/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-kube-api-access-ghwpm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.331122 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.330941    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.331336 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.331319    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.331371 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.331338    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.340716 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.340681    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwpm\" (UniqueName: \"kubernetes.io/projected/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-kube-api-access-ghwpm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.438322 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.438294    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:18.527268 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.527240    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"]
Jul 29 19:37:18.530661 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.530639    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.541030 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.540996    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"]
Jul 29 19:37:18.575101 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.575080    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"]
Jul 29 19:37:18.577400 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:37:18.577374    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5b3d63_80b6_4518_bbf6_28a9930fe58c.slice/crio-be4e05fcc2289e0fa81efe9b4812bd699867ebed1611a25ec51d1394fbb54068 WatchSource:0}: Error finding container be4e05fcc2289e0fa81efe9b4812bd699867ebed1611a25ec51d1394fbb54068: Status 404 returned error can't find the container with id be4e05fcc2289e0fa81efe9b4812bd699867ebed1611a25ec51d1394fbb54068
Jul 29 19:37:18.632450 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.632422    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.632548 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.632478    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvp28\" (UniqueName: \"kubernetes.io/projected/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-kube-api-access-zvp28\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.632548 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.632525    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.733548 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.733455    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvp28\" (UniqueName: \"kubernetes.io/projected/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-kube-api-access-zvp28\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.733548 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.733495    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.733548 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.733540    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.734043 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.733855    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.734043 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.733885    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.743187 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.743163    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvp28\" (UniqueName: \"kubernetes.io/projected/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-kube-api-access-zvp28\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.844731 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.844692    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:18.979690 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:18.979669    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"]
Jul 29 19:37:18.981375 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:37:18.981345    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f16cb72_18c1_4581_9ab1_1abc90ab35cc.slice/crio-92b578d26a1e59f178668389354170dc55122349474648d26964f155582c0f69 WatchSource:0}: Error finding container 92b578d26a1e59f178668389354170dc55122349474648d26964f155582c0f69: Status 404 returned error can't find the container with id 92b578d26a1e59f178668389354170dc55122349474648d26964f155582c0f69
Jul 29 19:37:19.060953 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:19.060907    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9" event={"ID":"0f16cb72-18c1-4581-9ab1-1abc90ab35cc","Type":"ContainerStarted","Data":"920d3d06fe68fdaf41188bc83c0528808585d0c8c738dd17d45cf78f9ecc0443"}
Jul 29 19:37:19.061152 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:19.061019    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9" event={"ID":"0f16cb72-18c1-4581-9ab1-1abc90ab35cc","Type":"ContainerStarted","Data":"92b578d26a1e59f178668389354170dc55122349474648d26964f155582c0f69"}
Jul 29 19:37:19.062570 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:19.062540    2531 generic.go:356] "Generic (PLEG): container finished" podID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerID="07e3d7a1c2a5de7a9925e444e629b3880fb5a466e4b8f1fa57886674b255417b" exitCode=0
Jul 29 19:37:19.062676 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:19.062575    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz" event={"ID":"dc5b3d63-80b6-4518-bbf6-28a9930fe58c","Type":"ContainerDied","Data":"07e3d7a1c2a5de7a9925e444e629b3880fb5a466e4b8f1fa57886674b255417b"}
Jul 29 19:37:19.062676 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:19.062626    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz" event={"ID":"dc5b3d63-80b6-4518-bbf6-28a9930fe58c","Type":"ContainerStarted","Data":"be4e05fcc2289e0fa81efe9b4812bd699867ebed1611a25ec51d1394fbb54068"}
Jul 29 19:37:19.064334 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:19.064310    2531 generic.go:356] "Generic (PLEG): container finished" podID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerID="7ac53d87caa7d2abac1ab600b3997b2c0d1565708025ed792be62e747dca511e" exitCode=0
Jul 29 19:37:19.064481 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:19.064402    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq" event={"ID":"0d83a104-6ee8-44a6-bd0e-6abf70c065e1","Type":"ContainerDied","Data":"7ac53d87caa7d2abac1ab600b3997b2c0d1565708025ed792be62e747dca511e"}
Jul 29 19:37:20.071833 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:20.071801    2531 generic.go:356] "Generic (PLEG): container finished" podID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerID="920d3d06fe68fdaf41188bc83c0528808585d0c8c738dd17d45cf78f9ecc0443" exitCode=0
Jul 29 19:37:20.072182 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:20.071875    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9" event={"ID":"0f16cb72-18c1-4581-9ab1-1abc90ab35cc","Type":"ContainerDied","Data":"920d3d06fe68fdaf41188bc83c0528808585d0c8c738dd17d45cf78f9ecc0443"}
Jul 29 19:37:21.078585 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.078489    2531 generic.go:356] "Generic (PLEG): container finished" podID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerID="f4aecb8bf6123e6e3203401a8fb985276abba411aaec40bca12b8e71a3d818d9" exitCode=0
Jul 29 19:37:21.078585 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.078551    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq" event={"ID":"0d83a104-6ee8-44a6-bd0e-6abf70c065e1","Type":"ContainerDied","Data":"f4aecb8bf6123e6e3203401a8fb985276abba411aaec40bca12b8e71a3d818d9"}
Jul 29 19:37:21.080560 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.080539    2531 generic.go:356] "Generic (PLEG): container finished" podID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerID="ae52df09378c07f2396bc048cdf39606b91779c3c4187cc750458c64d87afd8e" exitCode=0
Jul 29 19:37:21.080665 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.080625    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9" event={"ID":"0f16cb72-18c1-4581-9ab1-1abc90ab35cc","Type":"ContainerDied","Data":"ae52df09378c07f2396bc048cdf39606b91779c3c4187cc750458c64d87afd8e"}
Jul 29 19:37:21.082537 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.082513    2531 generic.go:356] "Generic (PLEG): container finished" podID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerID="a8cecc9e1d10fc94ba2ea99745b62ddafd063abfce74356cc4e1f8050f87d7a3" exitCode=0
Jul 29 19:37:21.082642 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.082568    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz" event={"ID":"dc5b3d63-80b6-4518-bbf6-28a9930fe58c","Type":"ContainerDied","Data":"a8cecc9e1d10fc94ba2ea99745b62ddafd063abfce74356cc4e1f8050f87d7a3"}
Jul 29 19:37:21.084565 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.084545    2531 generic.go:356] "Generic (PLEG): container finished" podID="9fa136d3-2961-471f-a61a-2430f256969b" containerID="08fb8821fe97fd306e16f16c53779f07db5764f0a7078cef09570f0efab6d77d" exitCode=0
Jul 29 19:37:21.084642 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:21.084573    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9" event={"ID":"9fa136d3-2961-471f-a61a-2430f256969b","Type":"ContainerDied","Data":"08fb8821fe97fd306e16f16c53779f07db5764f0a7078cef09570f0efab6d77d"}
Jul 29 19:37:22.095102 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.095047    2531 generic.go:356] "Generic (PLEG): container finished" podID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerID="4a457d132d0b340973ac31f41ce38d63d7eeb03be6b99040ce158c4e97430155" exitCode=0
Jul 29 19:37:22.095536 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.095164    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9" event={"ID":"0f16cb72-18c1-4581-9ab1-1abc90ab35cc","Type":"ContainerDied","Data":"4a457d132d0b340973ac31f41ce38d63d7eeb03be6b99040ce158c4e97430155"}
Jul 29 19:37:22.097174 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.097147    2531 generic.go:356] "Generic (PLEG): container finished" podID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerID="5574f1d1cb9b29a9b7c85201b061c5a27627aeee42ce5b33768cb9fa55bb4f7b" exitCode=0
Jul 29 19:37:22.097284 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.097220    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz" event={"ID":"dc5b3d63-80b6-4518-bbf6-28a9930fe58c","Type":"ContainerDied","Data":"5574f1d1cb9b29a9b7c85201b061c5a27627aeee42ce5b33768cb9fa55bb4f7b"}
Jul 29 19:37:22.099067 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.099032    2531 generic.go:356] "Generic (PLEG): container finished" podID="9fa136d3-2961-471f-a61a-2430f256969b" containerID="9206a354406f5293abf01c8884cc269f82a0c0fea846f7359da9fee2fdeccfe8" exitCode=0
Jul 29 19:37:22.099124 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.099086    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9" event={"ID":"9fa136d3-2961-471f-a61a-2430f256969b","Type":"ContainerDied","Data":"9206a354406f5293abf01c8884cc269f82a0c0fea846f7359da9fee2fdeccfe8"}
Jul 29 19:37:22.101129 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.101105    2531 generic.go:356] "Generic (PLEG): container finished" podID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerID="5d163460a23b594b5a549288de91612314fc30ce45f7fb1bc6377f0c328e5f08" exitCode=0
Jul 29 19:37:22.101218 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:22.101143    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq" event={"ID":"0d83a104-6ee8-44a6-bd0e-6abf70c065e1","Type":"ContainerDied","Data":"5d163460a23b594b5a549288de91612314fc30ce45f7fb1bc6377f0c328e5f08"}
Jul 29 19:37:23.279455 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.279434    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:23.281943 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.281928    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:23.310040 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.310013    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:23.312802 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.312782    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:23.375931 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.375849    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-util\") pod \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") "
Jul 29 19:37:23.375931 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.375886    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-bundle\") pod \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") "
Jul 29 19:37:23.375931 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.375904    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-bundle\") pod \"9fa136d3-2961-471f-a61a-2430f256969b\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") "
Jul 29 19:37:23.375931 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.375931    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crc4j\" (UniqueName: \"kubernetes.io/projected/9fa136d3-2961-471f-a61a-2430f256969b-kube-api-access-crc4j\") pod \"9fa136d3-2961-471f-a61a-2430f256969b\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") "
Jul 29 19:37:23.376290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.375954    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f58xt\" (UniqueName: \"kubernetes.io/projected/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-kube-api-access-f58xt\") pod \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\" (UID: \"0d83a104-6ee8-44a6-bd0e-6abf70c065e1\") "
Jul 29 19:37:23.376290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.375968    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-util\") pod \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") "
Jul 29 19:37:23.376290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.376137    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-util\") pod \"9fa136d3-2961-471f-a61a-2430f256969b\" (UID: \"9fa136d3-2961-471f-a61a-2430f256969b\") "
Jul 29 19:37:23.376290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.376172    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-bundle\") pod \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") "
Jul 29 19:37:23.376290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.376197    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-util\") pod \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") "
Jul 29 19:37:23.376290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.376221    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-bundle\") pod \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") "
Jul 29 19:37:23.376290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.376269    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvp28\" (UniqueName: \"kubernetes.io/projected/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-kube-api-access-zvp28\") pod \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\" (UID: \"0f16cb72-18c1-4581-9ab1-1abc90ab35cc\") "
Jul 29 19:37:23.376635 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.376336    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghwpm\" (UniqueName: \"kubernetes.io/projected/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-kube-api-access-ghwpm\") pod \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\" (UID: \"dc5b3d63-80b6-4518-bbf6-28a9930fe58c\") "
Jul 29 19:37:23.377392 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.377038    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-bundle" (OuterVolumeSpecName: "bundle") pod "dc5b3d63-80b6-4518-bbf6-28a9930fe58c" (UID: "dc5b3d63-80b6-4518-bbf6-28a9930fe58c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.377610 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.377589    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-bundle" (OuterVolumeSpecName: "bundle") pod "0d83a104-6ee8-44a6-bd0e-6abf70c065e1" (UID: "0d83a104-6ee8-44a6-bd0e-6abf70c065e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.377737 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.377673    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-bundle" (OuterVolumeSpecName: "bundle") pod "0f16cb72-18c1-4581-9ab1-1abc90ab35cc" (UID: "0f16cb72-18c1-4581-9ab1-1abc90ab35cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.378899 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.378858    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-bundle" (OuterVolumeSpecName: "bundle") pod "9fa136d3-2961-471f-a61a-2430f256969b" (UID: "9fa136d3-2961-471f-a61a-2430f256969b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.379342 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.379318    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-kube-api-access-f58xt" (OuterVolumeSpecName: "kube-api-access-f58xt") pod "0d83a104-6ee8-44a6-bd0e-6abf70c065e1" (UID: "0d83a104-6ee8-44a6-bd0e-6abf70c065e1"). InnerVolumeSpecName "kube-api-access-f58xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:37:23.379777 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.379756    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-kube-api-access-ghwpm" (OuterVolumeSpecName: "kube-api-access-ghwpm") pod "dc5b3d63-80b6-4518-bbf6-28a9930fe58c" (UID: "dc5b3d63-80b6-4518-bbf6-28a9930fe58c"). InnerVolumeSpecName "kube-api-access-ghwpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:37:23.379971 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.379954    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa136d3-2961-471f-a61a-2430f256969b-kube-api-access-crc4j" (OuterVolumeSpecName: "kube-api-access-crc4j") pod "9fa136d3-2961-471f-a61a-2430f256969b" (UID: "9fa136d3-2961-471f-a61a-2430f256969b"). InnerVolumeSpecName "kube-api-access-crc4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:37:23.380150 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.380132    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-kube-api-access-zvp28" (OuterVolumeSpecName: "kube-api-access-zvp28") pod "0f16cb72-18c1-4581-9ab1-1abc90ab35cc" (UID: "0f16cb72-18c1-4581-9ab1-1abc90ab35cc"). InnerVolumeSpecName "kube-api-access-zvp28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:37:23.381444 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.381402    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-util" (OuterVolumeSpecName: "util") pod "0d83a104-6ee8-44a6-bd0e-6abf70c065e1" (UID: "0d83a104-6ee8-44a6-bd0e-6abf70c065e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.382738 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.382719    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-util" (OuterVolumeSpecName: "util") pod "0f16cb72-18c1-4581-9ab1-1abc90ab35cc" (UID: "0f16cb72-18c1-4581-9ab1-1abc90ab35cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.383454 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.383428    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-util" (OuterVolumeSpecName: "util") pod "9fa136d3-2961-471f-a61a-2430f256969b" (UID: "9fa136d3-2961-471f-a61a-2430f256969b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.383983 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.383965    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-util" (OuterVolumeSpecName: "util") pod "dc5b3d63-80b6-4518-bbf6-28a9930fe58c" (UID: "dc5b3d63-80b6-4518-bbf6-28a9930fe58c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:37:23.477836 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477802    2531 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-util\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.477836 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477832    2531 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-bundle\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.477836 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477844    2531 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-bundle\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477856    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crc4j\" (UniqueName: \"kubernetes.io/projected/9fa136d3-2961-471f-a61a-2430f256969b-kube-api-access-crc4j\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477865    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f58xt\" (UniqueName: \"kubernetes.io/projected/0d83a104-6ee8-44a6-bd0e-6abf70c065e1-kube-api-access-f58xt\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477874    2531 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-util\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477882    2531 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fa136d3-2961-471f-a61a-2430f256969b-util\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477889    2531 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-bundle\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477896    2531 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-util\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477903    2531 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-bundle\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477910    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvp28\" (UniqueName: \"kubernetes.io/projected/0f16cb72-18c1-4581-9ab1-1abc90ab35cc-kube-api-access-zvp28\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:23.478179 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:23.477917    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghwpm\" (UniqueName: \"kubernetes.io/projected/dc5b3d63-80b6-4518-bbf6-28a9930fe58c-kube-api-access-ghwpm\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:37:24.111773 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.111748    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9"
Jul 29 19:37:24.111958 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.111746    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9" event={"ID":"0f16cb72-18c1-4581-9ab1-1abc90ab35cc","Type":"ContainerDied","Data":"92b578d26a1e59f178668389354170dc55122349474648d26964f155582c0f69"}
Jul 29 19:37:24.111958 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.111886    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92b578d26a1e59f178668389354170dc55122349474648d26964f155582c0f69"
Jul 29 19:37:24.113579 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.113562    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz"
Jul 29 19:37:24.113683 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.113577    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz" event={"ID":"dc5b3d63-80b6-4518-bbf6-28a9930fe58c","Type":"ContainerDied","Data":"be4e05fcc2289e0fa81efe9b4812bd699867ebed1611a25ec51d1394fbb54068"}
Jul 29 19:37:24.113683 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.113614    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be4e05fcc2289e0fa81efe9b4812bd699867ebed1611a25ec51d1394fbb54068"
Jul 29 19:37:24.115537 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.115520    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9"
Jul 29 19:37:24.115617 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.115550    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9" event={"ID":"9fa136d3-2961-471f-a61a-2430f256969b","Type":"ContainerDied","Data":"0e407cfebf3ba944204623c0d68dbcac184bf5048649fb918aa7c9f3186ca4a5"}
Jul 29 19:37:24.115617 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.115591    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e407cfebf3ba944204623c0d68dbcac184bf5048649fb918aa7c9f3186ca4a5"
Jul 29 19:37:24.117472 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.117453    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq" event={"ID":"0d83a104-6ee8-44a6-bd0e-6abf70c065e1","Type":"ContainerDied","Data":"08ea6ccd6189214001274f4950c283cb771c766596662aecc3a0c099bebd38c1"}
Jul 29 19:37:24.117568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.117483    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq"
Jul 29 19:37:24.117568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:37:24.117487    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08ea6ccd6189214001274f4950c283cb771c766596662aecc3a0c099bebd38c1"
Jul 29 19:40:09.954873 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.954838    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"]
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955095    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955106    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955114    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa136d3-2961-471f-a61a-2430f256969b" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955120    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa136d3-2961-471f-a61a-2430f256969b" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955130    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955136    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955143    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955148    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955155    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955161    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955166    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955171    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955177    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955182    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955192    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955196    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerName="util"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955201    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955206    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955213    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa136d3-2961-471f-a61a-2430f256969b" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955218    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa136d3-2961-471f-a61a-2430f256969b" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955223    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa136d3-2961-471f-a61a-2430f256969b" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955227    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa136d3-2961-471f-a61a-2430f256969b" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955234    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955238    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerName="pull"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955281    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f16cb72-18c1-4581-9ab1-1abc90ab35cc" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955288    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa136d3-2961-471f-a61a-2430f256969b" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955296    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d83a104-6ee8-44a6-bd0e-6abf70c065e1" containerName="extract"
Jul 29 19:40:09.957239 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.955303    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc5b3d63-80b6-4518-bbf6-28a9930fe58c" containerName="extract"
Jul 29 19:40:09.958148 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.958133    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:09.962144 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.962121    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t4xgq\""
Jul 29 19:40:09.962277 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.962206    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 19:40:09.972263 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:09.972240    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"]
Jul 29 19:40:10.025333 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.025300    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d355e025-5bdc-4459-93bb-11cae9eb1d23-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-82w2k\" (UID: \"d355e025-5bdc-4459-93bb-11cae9eb1d23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:10.025519 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.025414    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzpv\" (UniqueName: \"kubernetes.io/projected/d355e025-5bdc-4459-93bb-11cae9eb1d23-kube-api-access-thzpv\") pod \"payload-pre-processing-687dbb6cf6-82w2k\" (UID: \"d355e025-5bdc-4459-93bb-11cae9eb1d23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:10.126699 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.126655    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d355e025-5bdc-4459-93bb-11cae9eb1d23-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-82w2k\" (UID: \"d355e025-5bdc-4459-93bb-11cae9eb1d23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:10.126900 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.126749    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzpv\" (UniqueName: \"kubernetes.io/projected/d355e025-5bdc-4459-93bb-11cae9eb1d23-kube-api-access-thzpv\") pod \"payload-pre-processing-687dbb6cf6-82w2k\" (UID: \"d355e025-5bdc-4459-93bb-11cae9eb1d23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:10.127410 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.127388    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d355e025-5bdc-4459-93bb-11cae9eb1d23-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-82w2k\" (UID: \"d355e025-5bdc-4459-93bb-11cae9eb1d23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:10.137390 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.137361    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzpv\" (UniqueName: \"kubernetes.io/projected/d355e025-5bdc-4459-93bb-11cae9eb1d23-kube-api-access-thzpv\") pod \"payload-pre-processing-687dbb6cf6-82w2k\" (UID: \"d355e025-5bdc-4459-93bb-11cae9eb1d23\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:10.267750 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.267652    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:10.396811 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.396790    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"]
Jul 29 19:40:10.399112 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:40:10.399083    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd355e025_5bdc_4459_93bb_11cae9eb1d23.slice/crio-be1f33f8b92cbf907b86b3ea17657a1f2ca2232ae18df06c5e2fbac30293f489 WatchSource:0}: Error finding container be1f33f8b92cbf907b86b3ea17657a1f2ca2232ae18df06c5e2fbac30293f489: Status 404 returned error can't find the container with id be1f33f8b92cbf907b86b3ea17657a1f2ca2232ae18df06c5e2fbac30293f489
Jul 29 19:40:10.401018 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.401001    2531 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 19:40:10.830516 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:10.830479    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k" event={"ID":"d355e025-5bdc-4459-93bb-11cae9eb1d23","Type":"ContainerStarted","Data":"be1f33f8b92cbf907b86b3ea17657a1f2ca2232ae18df06c5e2fbac30293f489"}
Jul 29 19:40:12.840805 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:12.840765    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k" event={"ID":"d355e025-5bdc-4459-93bb-11cae9eb1d23","Type":"ContainerStarted","Data":"ec35108ae1e9ed96bae80be3f39fbbaad5454f182ffcb7365b432834ba8837c6"}
Jul 29 19:40:12.841238 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:12.840889    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:12.866520 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:12.866466    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k" podStartSLOduration=2.085201858 podStartE2EDuration="3.86645103s" totalImagesPullingTime="1.781249172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:40:12.864605075 +0000 UTC m=+621.018863695" watchObservedRunningTime="2026-07-29 19:40:12.86645103 +0000 UTC m=+621.020709648"
Jul 29 19:40:23.847246 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:23.847216    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-82w2k"
Jul 29 19:40:25.496554 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.496522    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"]
Jul 29 19:40:25.499592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.499576    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.502167 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.502137    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 19:40:25.502167 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.502150    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 19:40:25.502432 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.502184    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8fhrs\""
Jul 29 19:40:25.502432 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.502220    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 19:40:25.529854 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.529817    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"]
Jul 29 19:40:25.655409 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.655360    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ed63859-e94f-4f94-b8a5-b98f8e991d13-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.655409 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.655419    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.655677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.655479    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.655677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.655508    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qbqh\" (UniqueName: \"kubernetes.io/projected/7ed63859-e94f-4f94-b8a5-b98f8e991d13-kube-api-access-7qbqh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.655677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.655586    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.655677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.655620    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756416 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756320    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ed63859-e94f-4f94-b8a5-b98f8e991d13-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756416 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756373    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756416 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756400    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756697 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756429    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qbqh\" (UniqueName: \"kubernetes.io/projected/7ed63859-e94f-4f94-b8a5-b98f8e991d13-kube-api-access-7qbqh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756697 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756479    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756697 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756504    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756869 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756846    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756925 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756876    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.756925 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.756914    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.758760 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.758736    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ed63859-e94f-4f94-b8a5-b98f8e991d13-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.759006 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.758986    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ed63859-e94f-4f94-b8a5-b98f8e991d13-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.765987 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.765960    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qbqh\" (UniqueName: \"kubernetes.io/projected/7ed63859-e94f-4f94-b8a5-b98f8e991d13-kube-api-access-7qbqh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz\" (UID: \"7ed63859-e94f-4f94-b8a5-b98f8e991d13\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.810645 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.810603    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:25.953913 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:25.953882    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"]
Jul 29 19:40:25.956120 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:40:25.956094    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed63859_e94f_4f94_b8a5_b98f8e991d13.slice/crio-f021053a7321a9b35dc2e4f1ad3d7a496cce0885bfa353cbd55a67eb8d91869b WatchSource:0}: Error finding container f021053a7321a9b35dc2e4f1ad3d7a496cce0885bfa353cbd55a67eb8d91869b: Status 404 returned error can't find the container with id f021053a7321a9b35dc2e4f1ad3d7a496cce0885bfa353cbd55a67eb8d91869b
Jul 29 19:40:26.908194 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:26.908159    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz" event={"ID":"7ed63859-e94f-4f94-b8a5-b98f8e991d13","Type":"ContainerStarted","Data":"f021053a7321a9b35dc2e4f1ad3d7a496cce0885bfa353cbd55a67eb8d91869b"}
Jul 29 19:40:27.918331 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:27.918299    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz" event={"ID":"7ed63859-e94f-4f94-b8a5-b98f8e991d13","Type":"ContainerStarted","Data":"1ab99cd0a6777c7b8de57812eebdbbfadb73fa8dc05f5ac59fe03ccf8718e054"}
Jul 29 19:40:27.942591 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:27.942542    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz" podStartSLOduration=1.8879667599999999 podStartE2EDuration="2.942527541s" totalImagesPullingTime="1.054560781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:40:27.940545722 +0000 UTC m=+636.094804341" watchObservedRunningTime="2026-07-29 19:40:27.942527541 +0000 UTC m=+636.096786161"
Jul 29 19:40:30.778545 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.778473    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"]
Jul 29 19:40:30.781743 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.781720    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.784374 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.784351    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 19:40:30.793098 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.793072    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"]
Jul 29 19:40:30.897434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.897396    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.897434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.897447    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.897677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.897476    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29a9684-9a65-460c-9387-ebef2269aee4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.897677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.897500    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7w68\" (UniqueName: \"kubernetes.io/projected/d29a9684-9a65-460c-9387-ebef2269aee4-kube-api-access-f7w68\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.897677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.897536    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.897677 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.897552    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.998773 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.998738    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.998773 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.998773    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.999015 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.998808    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.999015 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.998928    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.999015 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.998981    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29a9684-9a65-460c-9387-ebef2269aee4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.999015 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.999005    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7w68\" (UniqueName: \"kubernetes.io/projected/d29a9684-9a65-460c-9387-ebef2269aee4-kube-api-access-f7w68\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.999302 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.999277    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.999388 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.999318    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:30.999434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:30.999391    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:31.001269 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.001247    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d29a9684-9a65-460c-9387-ebef2269aee4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:31.001562 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.001545    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d29a9684-9a65-460c-9387-ebef2269aee4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:31.009044 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.009023    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7w68\" (UniqueName: \"kubernetes.io/projected/d29a9684-9a65-460c-9387-ebef2269aee4-kube-api-access-f7w68\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4bqdw\" (UID: \"d29a9684-9a65-460c-9387-ebef2269aee4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:31.092021 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.091943    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:31.229653 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.229630    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"]
Jul 29 19:40:31.231369 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:40:31.231343    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd29a9684_9a65_460c_9387_ebef2269aee4.slice/crio-4159ccfa560ed061c56c6ff350aee9a77d9bd90eed0cec317108e33553f41927 WatchSource:0}: Error finding container 4159ccfa560ed061c56c6ff350aee9a77d9bd90eed0cec317108e33553f41927: Status 404 returned error can't find the container with id 4159ccfa560ed061c56c6ff350aee9a77d9bd90eed0cec317108e33553f41927
Jul 29 19:40:31.937088 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.937038    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw" event={"ID":"d29a9684-9a65-460c-9387-ebef2269aee4","Type":"ContainerStarted","Data":"5a5b3d760e9d503c9f7dc350494c01fb589da2df6831a331d038ec126e8c243c"}
Jul 29 19:40:31.937469 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.937104    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw" event={"ID":"d29a9684-9a65-460c-9387-ebef2269aee4","Type":"ContainerStarted","Data":"4159ccfa560ed061c56c6ff350aee9a77d9bd90eed0cec317108e33553f41927"}
Jul 29 19:40:31.966974 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:31.966921    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw" podStartSLOduration=1.791587472 podStartE2EDuration="1.966905961s" totalImagesPullingTime="175.318489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:40:31.965752043 +0000 UTC m=+640.120010678" watchObservedRunningTime="2026-07-29 19:40:31.966905961 +0000 UTC m=+640.121164579"
Jul 29 19:40:35.810904 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:35.810867    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:35.811338 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:35.810954    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:35.823346 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:35.823326    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:35.965102 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:35.965049    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz"
Jul 29 19:40:41.092792 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:41.092757    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:41.093222 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:41.092845    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:41.105172 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:41.105152    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:40:41.992316 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:40:41.992290    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4bqdw"
Jul 29 19:45:00.146458 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:00.146378    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv"]
Jul 29 19:45:00.149480 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:00.149465    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv"
Jul 29 19:45:00.151785 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:00.151764    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 19:45:00.157940 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:00.157917    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv"]
Jul 29 19:45:00.158984 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:00.158966    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv"
Jul 29 19:45:00.296322 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:00.296298    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv"]
Jul 29 19:45:00.297548 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:45:00.297523    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1d115c_d9ca_4fbf_9270_6f66fe18f431.slice/crio-63dc8cb11765879016d03a0ca493d282a5b90021b28c782906547acb539b1d53 WatchSource:0}: Error finding container 63dc8cb11765879016d03a0ca493d282a5b90021b28c782906547acb539b1d53: Status 404 returned error can't find the container with id 63dc8cb11765879016d03a0ca493d282a5b90021b28c782906547acb539b1d53
Jul 29 19:45:01.143790 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:01.143755    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv" event={"ID":"8f1d115c-d9ca-4fbf-9270-6f66fe18f431","Type":"ContainerStarted","Data":"63dc8cb11765879016d03a0ca493d282a5b90021b28c782906547acb539b1d53"}
Jul 29 19:45:04.162771 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:04.162728    2531 generic.go:356] "Generic (PLEG): container finished" podID="8f1d115c-d9ca-4fbf-9270-6f66fe18f431" containerID="7c3fad7817e7721232c293d2f761876f3814f9e3d4228326d2d8d00778287d38" exitCode=0
Jul 29 19:45:04.163204 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:04.162777    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv" event={"ID":"8f1d115c-d9ca-4fbf-9270-6f66fe18f431","Type":"ContainerDied","Data":"7c3fad7817e7721232c293d2f761876f3814f9e3d4228326d2d8d00778287d38"}
Jul 29 19:45:05.289753 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:05.289730    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv"
Jul 29 19:45:06.172941 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:06.172911    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv"
Jul 29 19:45:06.173109 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:06.172915    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755905-xp8xv" event={"ID":"8f1d115c-d9ca-4fbf-9270-6f66fe18f431","Type":"ContainerDied","Data":"63dc8cb11765879016d03a0ca493d282a5b90021b28c782906547acb539b1d53"}
Jul 29 19:45:06.173109 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:45:06.173033    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63dc8cb11765879016d03a0ca493d282a5b90021b28c782906547acb539b1d53"
Jul 29 19:54:11.875882 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.875840    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"]
Jul 29 19:54:11.876370 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.876342    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1d115c-d9ca-4fbf-9270-6f66fe18f431" containerName="cleanup"
Jul 29 19:54:11.876418 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.876375    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1d115c-d9ca-4fbf-9270-6f66fe18f431" containerName="cleanup"
Jul 29 19:54:11.876474 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.876462    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1d115c-d9ca-4fbf-9270-6f66fe18f431" containerName="cleanup"
Jul 29 19:54:11.879748 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.879729    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:11.882233 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.882212    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-fa67c245-kserve-self-signed-certs\""
Jul 29 19:54:11.888537 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.888511    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"]
Jul 29 19:54:11.907359 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.907276    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/0265d992-0e2f-4178-8c07-25ef98c174fe-kube-api-access-cpbpq\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:11.907359 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.907313    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-home\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:11.907359 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.907338    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-model-cache\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:11.907551 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.907414    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0265d992-0e2f-4178-8c07-25ef98c174fe-tls-certs\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:11.907551 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.907473    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-tmp-dir\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:11.907551 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:11.907503    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-dshm\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008241 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008196    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-home\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008450 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008249    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-model-cache\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008450 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008298    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0265d992-0e2f-4178-8c07-25ef98c174fe-tls-certs\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008450 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008342    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-tmp-dir\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008617 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008505    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-dshm\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008691 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008666    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/0265d992-0e2f-4178-8c07-25ef98c174fe-kube-api-access-cpbpq\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008750 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008733    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-tmp-dir\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008801 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008677    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-home\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.008842 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.008780    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-model-cache\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.010874 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.010846    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-dshm\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.011021 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.011006    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0265d992-0e2f-4178-8c07-25ef98c174fe-tls-certs\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.017413 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.017386    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/0265d992-0e2f-4178-8c07-25ef98c174fe-kube-api-access-cpbpq\") pod \"e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") " pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.189712 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.189685    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:12.324501 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.324442    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"]
Jul 29 19:54:12.326762 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:54:12.326736    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0265d992_0e2f_4178_8c07_25ef98c174fe.slice/crio-81ceb897cbf2a4a9425cd3f1cc05c7afa6d9500a4d9d9d46db9fe46d96dccb3c WatchSource:0}: Error finding container 81ceb897cbf2a4a9425cd3f1cc05c7afa6d9500a4d9d9d46db9fe46d96dccb3c: Status 404 returned error can't find the container with id 81ceb897cbf2a4a9425cd3f1cc05c7afa6d9500a4d9d9d46db9fe46d96dccb3c
Jul 29 19:54:12.597553 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.597462    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg" event={"ID":"0265d992-0e2f-4178-8c07-25ef98c174fe","Type":"ContainerStarted","Data":"f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773"}
Jul 29 19:54:12.597553 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.597506    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg" event={"ID":"0265d992-0e2f-4178-8c07-25ef98c174fe","Type":"ContainerStarted","Data":"81ceb897cbf2a4a9425cd3f1cc05c7afa6d9500a4d9d9d46db9fe46d96dccb3c"}
Jul 29 19:54:12.617458 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:12.617402    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg" podStartSLOduration=1.617386487 podStartE2EDuration="1.617386487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:12.615192469 +0000 UTC m=+1460.769451088" watchObservedRunningTime="2026-07-29 19:54:12.617386487 +0000 UTC m=+1460.771645106"
Jul 29 19:54:22.190568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:22.190536    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:22.190981 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:22.190589    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:22.203006 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:22.202981    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:22.652515 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:22.652435    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:54:51.095663 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:54:51.095632    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"]
Jul 29 19:55:06.115267 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.115186    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg" podUID="0265d992-0e2f-4178-8c07-25ef98c174fe" containerName="main" containerID="cri-o://f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773" gracePeriod=45
Jul 29 19:55:06.368592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.368528    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:55:06.460957 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.460923    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-tmp-dir\") pod \"0265d992-0e2f-4178-8c07-25ef98c174fe\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") "
Jul 29 19:55:06.460957 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.460961    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-dshm\") pod \"0265d992-0e2f-4178-8c07-25ef98c174fe\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") "
Jul 29 19:55:06.461227 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.460992    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-home\") pod \"0265d992-0e2f-4178-8c07-25ef98c174fe\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") "
Jul 29 19:55:06.461227 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461021    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-model-cache\") pod \"0265d992-0e2f-4178-8c07-25ef98c174fe\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") "
Jul 29 19:55:06.461227 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461047    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/0265d992-0e2f-4178-8c07-25ef98c174fe-kube-api-access-cpbpq\") pod \"0265d992-0e2f-4178-8c07-25ef98c174fe\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") "
Jul 29 19:55:06.461227 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461094    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0265d992-0e2f-4178-8c07-25ef98c174fe-tls-certs\") pod \"0265d992-0e2f-4178-8c07-25ef98c174fe\" (UID: \"0265d992-0e2f-4178-8c07-25ef98c174fe\") "
Jul 29 19:55:06.461399 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461242    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0265d992-0e2f-4178-8c07-25ef98c174fe" (UID: "0265d992-0e2f-4178-8c07-25ef98c174fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:55:06.461399 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461318    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-home" (OuterVolumeSpecName: "home") pod "0265d992-0e2f-4178-8c07-25ef98c174fe" (UID: "0265d992-0e2f-4178-8c07-25ef98c174fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:55:06.461399 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461330    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "0265d992-0e2f-4178-8c07-25ef98c174fe" (UID: "0265d992-0e2f-4178-8c07-25ef98c174fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:55:06.461535 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461404    2531 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-model-cache\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:55:06.461535 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461442    2531 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-tmp-dir\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:55:06.461535 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.461451    2531 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-home\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:55:06.463593 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.463567    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0265d992-0e2f-4178-8c07-25ef98c174fe-kube-api-access-cpbpq" (OuterVolumeSpecName: "kube-api-access-cpbpq") pod "0265d992-0e2f-4178-8c07-25ef98c174fe" (UID: "0265d992-0e2f-4178-8c07-25ef98c174fe"). InnerVolumeSpecName "kube-api-access-cpbpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:55:06.463669 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.463597    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0265d992-0e2f-4178-8c07-25ef98c174fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0265d992-0e2f-4178-8c07-25ef98c174fe" (UID: "0265d992-0e2f-4178-8c07-25ef98c174fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 19:55:06.463709 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.463670    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-dshm" (OuterVolumeSpecName: "dshm") pod "0265d992-0e2f-4178-8c07-25ef98c174fe" (UID: "0265d992-0e2f-4178-8c07-25ef98c174fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:55:06.562820 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.562781    2531 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0265d992-0e2f-4178-8c07-25ef98c174fe-dshm\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:55:06.562820 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.562814    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/0265d992-0e2f-4178-8c07-25ef98c174fe-kube-api-access-cpbpq\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:55:06.562820 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.562828    2531 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0265d992-0e2f-4178-8c07-25ef98c174fe-tls-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:55:06.836012 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.835972    2531 generic.go:356] "Generic (PLEG): container finished" podID="0265d992-0e2f-4178-8c07-25ef98c174fe" containerID="f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773" exitCode=0
Jul 29 19:55:06.836196 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.836021    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"
Jul 29 19:55:06.836196 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.836069    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg" event={"ID":"0265d992-0e2f-4178-8c07-25ef98c174fe","Type":"ContainerDied","Data":"f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773"}
Jul 29 19:55:06.836196 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.836119    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg" event={"ID":"0265d992-0e2f-4178-8c07-25ef98c174fe","Type":"ContainerDied","Data":"81ceb897cbf2a4a9425cd3f1cc05c7afa6d9500a4d9d9d46db9fe46d96dccb3c"}
Jul 29 19:55:06.836196 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.836137    2531 scope.go:117] "RemoveContainer" containerID="f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773"
Jul 29 19:55:06.845531 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.845510    2531 scope.go:117] "RemoveContainer" containerID="f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773"
Jul 29 19:55:06.845751 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:55:06.845733    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773\": container with ID starting with f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773 not found: ID does not exist" containerID="f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773"
Jul 29 19:55:06.845817 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.845762    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773"} err="failed to get container status \"f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773\": rpc error: code = NotFound desc = could not find container \"f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773\": container with ID starting with f5ec8d21846d9fa715b916f4e105bef2741e52f1c7d35ecf29d0f9eaf56c9773 not found: ID does not exist"
Jul 29 19:55:06.858967 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.858923    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"]
Jul 29 19:55:06.860715 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:06.860696    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-fa67c245-kserve-587c9f464c-65jmg"]
Jul 29 19:55:08.371422 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:55:08.371390    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0265d992-0e2f-4178-8c07-25ef98c174fe" path="/var/lib/kubelet/pods/0265d992-0e2f-4178-8c07-25ef98c174fe/volumes"
Jul 29 19:58:24.941364 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.941284    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"]
Jul 29 19:58:24.943590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.941583    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0265d992-0e2f-4178-8c07-25ef98c174fe" containerName="main"
Jul 29 19:58:24.943590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.941593    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="0265d992-0e2f-4178-8c07-25ef98c174fe" containerName="main"
Jul 29 19:58:24.943590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.941658    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="0265d992-0e2f-4178-8c07-25ef98c174fe" containerName="main"
Jul 29 19:58:24.944429 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.944414    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.947000 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.946975    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c9fa71cf-openshift-default-dockercfg-8w6m6\""
Jul 29 19:58:24.969098 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.969048    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"]
Jul 29 19:58:24.999459 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999425    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-podinfo\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999459 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999455    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istiod-ca-cert\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999634 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999489    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-token\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999634 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999548    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-credential-socket\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999634 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999582    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-certs\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999634 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999601    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-socket\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999634 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999616    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-envoy\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999788 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999638    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-data\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:24.999788 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:24.999710    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkxg2\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-kube-api-access-hkxg2\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100491 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100456    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-token\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100491 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100495    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-credential-socket\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100715 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100516    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-certs\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100715 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100534    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-socket\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100715 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100660    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-envoy\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100862 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100714    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-data\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100862 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100802    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkxg2\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-kube-api-access-hkxg2\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100862 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100836    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-podinfo\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.100862 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100857    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istiod-ca-cert\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.101048 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100910    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-socket\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.101048 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100960    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-credential-socket\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.101048 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.100982    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-certs\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.101219 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.101154    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-data\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.101505 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.101481    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istiod-ca-cert\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.103105 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.103085    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-envoy\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.103343 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.103328    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-podinfo\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.110157 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.110128    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-token\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.110412 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.110392    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkxg2\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-kube-api-access-hkxg2\") pod \"e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") " pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.254009 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.253930    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:25.391005 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.390981    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"]
Jul 29 19:58:25.396347 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.396311    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:25.396473 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.396401    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:25.396473 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.396444    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:25.721038 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.721002    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" event={"ID":"16cafec6-d1f2-4b27-a8b5-7a6756761f12","Type":"ContainerStarted","Data":"9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544"}
Jul 29 19:58:25.721240 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.721106    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" event={"ID":"16cafec6-d1f2-4b27-a8b5-7a6756761f12","Type":"ContainerStarted","Data":"957d170e43e84d41fb2fb8281b8b1a5a1d89ba0855f754691225736b6be88f2a"}
Jul 29 19:58:25.743592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:25.743542    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" podStartSLOduration=1.7435243470000001 podStartE2EDuration="1.743524347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:58:25.743162596 +0000 UTC m=+1713.897421216" watchObservedRunningTime="2026-07-29 19:58:25.743524347 +0000 UTC m=+1713.897782967"
Jul 29 19:58:26.254429 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:26.254397    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:26.259368 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:26.259349    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:26.725694 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:26.725660    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:26.726745 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:26.726723    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:27.902814 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:27.902779    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"]
Jul 29 19:58:27.905898 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:27.905880    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:27.908220 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:27.908201    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c9fa71cf\""
Jul 29 19:58:27.908340 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:27.908222    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c9fa71cf-dockercfg-9r566\""
Jul 29 19:58:27.916956 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:27.916935    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"]
Jul 29 19:58:28.029689 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.029651    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e057bb-2f75-4085-94a9-fb979dd87ca0-plugins-config-volume\") pod \"payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") " pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.029893 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.029775    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sl42\" (UniqueName: \"kubernetes.io/projected/45e057bb-2f75-4085-94a9-fb979dd87ca0-kube-api-access-5sl42\") pod \"payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") " pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.130455 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.130418    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e057bb-2f75-4085-94a9-fb979dd87ca0-plugins-config-volume\") pod \"payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") " pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.130620 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.130467    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sl42\" (UniqueName: \"kubernetes.io/projected/45e057bb-2f75-4085-94a9-fb979dd87ca0-kube-api-access-5sl42\") pod \"payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") " pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.131139 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.131120    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e057bb-2f75-4085-94a9-fb979dd87ca0-plugins-config-volume\") pod \"payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") " pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.140956 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.140935    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sl42\" (UniqueName: \"kubernetes.io/projected/45e057bb-2f75-4085-94a9-fb979dd87ca0-kube-api-access-5sl42\") pod \"payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") " pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.216782 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.216751    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.347340 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.347311    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"]
Jul 29 19:58:28.350193 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:58:28.350166    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e057bb_2f75_4085_94a9_fb979dd87ca0.slice/crio-b36ddae24b68dec53643246705a0f1a6886d314ffc1c5cc8cf2efcc0983e2178 WatchSource:0}: Error finding container b36ddae24b68dec53643246705a0f1a6886d314ffc1c5cc8cf2efcc0983e2178: Status 404 returned error can't find the container with id b36ddae24b68dec53643246705a0f1a6886d314ffc1c5cc8cf2efcc0983e2178
Jul 29 19:58:28.736526 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.736484    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9" event={"ID":"45e057bb-2f75-4085-94a9-fb979dd87ca0","Type":"ContainerStarted","Data":"d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1"}
Jul 29 19:58:28.736706 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.736578    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:28.736706 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.736619    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9" event={"ID":"45e057bb-2f75-4085-94a9-fb979dd87ca0","Type":"ContainerStarted","Data":"b36ddae24b68dec53643246705a0f1a6886d314ffc1c5cc8cf2efcc0983e2178"}
Jul 29 19:58:28.754890 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:28.754845    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9" podStartSLOduration=1.75483134 podStartE2EDuration="1.75483134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:58:28.75392209 +0000 UTC m=+1716.908180710" watchObservedRunningTime="2026-07-29 19:58:28.75483134 +0000 UTC m=+1716.909089959"
Jul 29 19:58:38.784454 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:38.783522    2531 generic.go:356] "Generic (PLEG): container finished" podID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerID="9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544" exitCode=0
Jul 29 19:58:38.784454 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:38.783637    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" event={"ID":"16cafec6-d1f2-4b27-a8b5-7a6756761f12","Type":"ContainerDied","Data":"9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544"}
Jul 29 19:58:38.784454 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:38.784126    2531 scope.go:117] "RemoveContainer" containerID="9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544"
Jul 29 19:58:38.785484 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:38.785451    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:38.785599 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:38.785537    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:38.785663 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:38.785606    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:39.744437 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:39.744408    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:39.795079 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:39.794328    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" event={"ID":"16cafec6-d1f2-4b27-a8b5-7a6756761f12","Type":"ContainerStarted","Data":"5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a"}
Jul 29 19:58:40.254314 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:40.254276    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:40.255487 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:40.255459    2531 patch_prober.go:28] interesting pod/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 19:58:40.255598 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:40.255525    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 19:58:41.254999 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:41.254960    2531 patch_prober.go:28] interesting pod/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 19:58:41.255494 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:41.255026    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 19:58:41.725800 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:41.725767    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:42.255014 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:42.254980    2531 patch_prober.go:28] interesting pod/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 19:58:42.255422 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:42.255033    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 19:58:43.254569 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:43.254532    2531 patch_prober.go:28] interesting pod/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 29 19:58:43.254740 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:43.254589    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 29 19:58:44.258274 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:44.258243    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:44.259087 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:44.259047    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:58:52.609633 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.609599    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"]
Jul 29 19:58:52.612793 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.612777    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"
Jul 29 19:58:52.615025 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.615005    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:58:52.615155 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.615014    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 19:58:52.620572 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.620546    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"]
Jul 29 19:58:52.744766 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.744730    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r\" (UID: \"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"
Jul 29 19:58:52.845987 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.845956    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r\" (UID: \"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"
Jul 29 19:58:52.846651 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.846632    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r\" (UID: \"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"
Jul 29 19:58:52.924240 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:52.924156    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"
Jul 29 19:58:53.052411 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:53.052387    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"]
Jul 29 19:58:53.053889 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:58:53.053862    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3d8b36_3dbe_4371_99cb_f1be8ad1ed6d.slice/crio-2a74e4fc313c9916e5ddc293118670cd57994332fbe03689aab69d39e965b107 WatchSource:0}: Error finding container 2a74e4fc313c9916e5ddc293118670cd57994332fbe03689aab69d39e965b107: Status 404 returned error can't find the container with id 2a74e4fc313c9916e5ddc293118670cd57994332fbe03689aab69d39e965b107
Jul 29 19:58:53.861583 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:53.861549    2531 generic.go:356] "Generic (PLEG): container finished" podID="de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d" containerID="4eb6c05d55bcdb5082c915a7b798e5b6ca520a9b9d5c354bf7cf8e6bb264216e" exitCode=0
Jul 29 19:58:53.861974 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:53.861614    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r" event={"ID":"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d","Type":"ContainerDied","Data":"4eb6c05d55bcdb5082c915a7b798e5b6ca520a9b9d5c354bf7cf8e6bb264216e"}
Jul 29 19:58:53.861974 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:53.861661    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r" event={"ID":"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d","Type":"ContainerStarted","Data":"2a74e4fc313c9916e5ddc293118670cd57994332fbe03689aab69d39e965b107"}
Jul 29 19:58:54.992274 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:54.992254    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"
Jul 29 19:58:55.166322 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:55.166225    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d-maas-api-service-ca\") pod \"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d\" (UID: \"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d\") "
Jul 29 19:58:55.166646 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:55.166617    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d" (UID: "de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:58:55.267642 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:55.267604    2531 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d-maas-api-service-ca\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:58:55.871275 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:55.871244    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r" event={"ID":"de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d","Type":"ContainerDied","Data":"2a74e4fc313c9916e5ddc293118670cd57994332fbe03689aab69d39e965b107"}
Jul 29 19:58:55.871275 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:55.871266    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"
Jul 29 19:58:55.871482 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:55.871292    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a74e4fc313c9916e5ddc293118670cd57994332fbe03689aab69d39e965b107"
Jul 29 19:58:57.933854 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:57.933822    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"]
Jul 29 19:58:57.934487 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:57.934081    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9" podUID="45e057bb-2f75-4085-94a9-fb979dd87ca0" containerName="payload-processing" containerID="cri-o://d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1" gracePeriod=30
Jul 29 19:58:58.093856 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.093821    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"]
Jul 29 19:58:58.098901 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.098870    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c9fa71cf-6ch9r"]
Jul 29 19:58:58.183588 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.183563    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:58.241639 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.241605    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"]
Jul 29 19:58:58.241813 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.241794    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy" containerID="cri-o://5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a" gracePeriod=30
Jul 29 19:58:58.293033 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.293002    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e057bb-2f75-4085-94a9-fb979dd87ca0-plugins-config-volume\") pod \"45e057bb-2f75-4085-94a9-fb979dd87ca0\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") "
Jul 29 19:58:58.293190 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.293124    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sl42\" (UniqueName: \"kubernetes.io/projected/45e057bb-2f75-4085-94a9-fb979dd87ca0-kube-api-access-5sl42\") pod \"45e057bb-2f75-4085-94a9-fb979dd87ca0\" (UID: \"45e057bb-2f75-4085-94a9-fb979dd87ca0\") "
Jul 29 19:58:58.293349 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.293327    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e057bb-2f75-4085-94a9-fb979dd87ca0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45e057bb-2f75-4085-94a9-fb979dd87ca0" (UID: "45e057bb-2f75-4085-94a9-fb979dd87ca0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:58:58.295357 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.295328    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e057bb-2f75-4085-94a9-fb979dd87ca0-kube-api-access-5sl42" (OuterVolumeSpecName: "kube-api-access-5sl42") pod "45e057bb-2f75-4085-94a9-fb979dd87ca0" (UID: "45e057bb-2f75-4085-94a9-fb979dd87ca0"). InnerVolumeSpecName "kube-api-access-5sl42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:58:58.373048 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.373017    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d" path="/var/lib/kubelet/pods/de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d/volumes"
Jul 29 19:58:58.394107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.394084    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sl42\" (UniqueName: \"kubernetes.io/projected/45e057bb-2f75-4085-94a9-fb979dd87ca0-kube-api-access-5sl42\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:58:58.394107 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.394103    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e057bb-2f75-4085-94a9-fb979dd87ca0-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:58:58.886830 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.886794    2531 generic.go:356] "Generic (PLEG): container finished" podID="45e057bb-2f75-4085-94a9-fb979dd87ca0" containerID="d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1" exitCode=0
Jul 29 19:58:58.886997 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.886849    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"
Jul 29 19:58:58.886997 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.886889    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9" event={"ID":"45e057bb-2f75-4085-94a9-fb979dd87ca0","Type":"ContainerDied","Data":"d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1"}
Jul 29 19:58:58.886997 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.886961    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9" event={"ID":"45e057bb-2f75-4085-94a9-fb979dd87ca0","Type":"ContainerDied","Data":"b36ddae24b68dec53643246705a0f1a6886d314ffc1c5cc8cf2efcc0983e2178"}
Jul 29 19:58:58.886997 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.886983    2531 scope.go:117] "RemoveContainer" containerID="d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1"
Jul 29 19:58:58.895569 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.895550    2531 scope.go:117] "RemoveContainer" containerID="d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1"
Jul 29 19:58:58.895821 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:58:58.895803    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1\": container with ID starting with d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1 not found: ID does not exist" containerID="d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1"
Jul 29 19:58:58.895875 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.895828    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1"} err="failed to get container status \"d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1\": rpc error: code = NotFound desc = could not find container \"d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1\": container with ID starting with d0ef02b674368586ed22d2d2d43b7ffb2b66054bf2d118cafdc9989686faa8e1 not found: ID does not exist"
Jul 29 19:58:58.907326 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.907303    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"]
Jul 29 19:58:58.913801 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:58.913778    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c9fa71cf-585759f876-pmnd9"]
Jul 29 19:58:59.168108 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.167999    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"]
Jul 29 19:58:59.168568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.168512    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d" containerName="revoke-keys"
Jul 29 19:58:59.168568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.168528    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d" containerName="revoke-keys"
Jul 29 19:58:59.168568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.168540    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e057bb-2f75-4085-94a9-fb979dd87ca0" containerName="payload-processing"
Jul 29 19:58:59.168568 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.168546    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e057bb-2f75-4085-94a9-fb979dd87ca0" containerName="payload-processing"
Jul 29 19:58:59.168758 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.168614    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3d8b36-3dbe-4371-99cb-f1be8ad1ed6d" containerName="revoke-keys"
Jul 29 19:58:59.168758 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.168625    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e057bb-2f75-4085-94a9-fb979dd87ca0" containerName="payload-processing"
Jul 29 19:58:59.172981 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.172963    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.175593 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.175578    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-fbe86793-gw-openshift-default-dockercfg-bl8vz\""
Jul 29 19:58:59.183918 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.183899    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"]
Jul 29 19:58:59.260963 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.260927    2531 patch_prober.go:28] interesting pod/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 19:58:59.261160 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.260988    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 19:58:59.301679 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301651    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-podinfo\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.301848 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301684    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr5kx\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-kube-api-access-sr5kx\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.301848 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301716    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-credential-socket\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.301848 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301758    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-socket\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.301848 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301787    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-token\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.301848 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301805    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2296f45a-5d9a-441d-bbcd-301260ac30f8-istiod-ca-cert\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.301848 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301829    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-data\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.302039 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301883    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-envoy\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.302039 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.301949    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-certs\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.402544 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.402515    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-envoy\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.402718 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.402579    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-certs\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.402718 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.402613    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-podinfo\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.402718 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.402632    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr5kx\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-kube-api-access-sr5kx\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.402718 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.402657    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-credential-socket\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.404290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.403898    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-socket\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.404290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.403955    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-token\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.404290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.403993    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2296f45a-5d9a-441d-bbcd-301260ac30f8-istiod-ca-cert\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.404290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.404038    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-data\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.404290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.404217    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-certs\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.404290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.404228    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-credential-socket\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.404847 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.404823    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-socket\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.405265 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.405244    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-data\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.405392 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.405345    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2296f45a-5d9a-441d-bbcd-301260ac30f8-istiod-ca-cert\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.411129 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.411096    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-envoy\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.411297 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.411257    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-podinfo\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.413320 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.413295    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr5kx\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-kube-api-access-sr5kx\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.413588 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.413566    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-token\") pod \"e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") " pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.483706 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.483675    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:58:59.620001 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.619975    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"]
Jul 29 19:58:59.621640 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:58:59.621615    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2296f45a_5d9a_441d_bbcd_301260ac30f8.slice/crio-f6243b4d3125f1d437c77c7ce6d9694d3f99d7aff1ba8a611a1cbc3fa5ad7c2a WatchSource:0}: Error finding container f6243b4d3125f1d437c77c7ce6d9694d3f99d7aff1ba8a611a1cbc3fa5ad7c2a: Status 404 returned error can't find the container with id f6243b4d3125f1d437c77c7ce6d9694d3f99d7aff1ba8a611a1cbc3fa5ad7c2a
Jul 29 19:58:59.623865 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.623830    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:59.623953 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.623897    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:59.623953 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.623925    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:58:59.894369 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.894283    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" event={"ID":"2296f45a-5d9a-441d-bbcd-301260ac30f8","Type":"ContainerStarted","Data":"6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf"}
Jul 29 19:58:59.894369 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.894331    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" event={"ID":"2296f45a-5d9a-441d-bbcd-301260ac30f8","Type":"ContainerStarted","Data":"f6243b4d3125f1d437c77c7ce6d9694d3f99d7aff1ba8a611a1cbc3fa5ad7c2a"}
Jul 29 19:58:59.915907 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:58:59.915839    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" podStartSLOduration=0.915819561 podStartE2EDuration="915.819561ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:58:59.915378658 +0000 UTC m=+1748.069637279" watchObservedRunningTime="2026-07-29 19:58:59.915819561 +0000 UTC m=+1748.070078181"
Jul 29 19:59:00.371346 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:00.371304    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e057bb-2f75-4085-94a9-fb979dd87ca0" path="/var/lib/kubelet/pods/45e057bb-2f75-4085-94a9-fb979dd87ca0/volumes"
Jul 29 19:59:00.484500 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:00.484460    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:00.489260 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:00.489240    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:00.899300 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:00.899270    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:00.900432 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:00.900413    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:03.489320 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.489293    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:59:03.642009 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.641915    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-data\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642009 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.641955    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-certs\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642009 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.641996    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-token\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642285 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642031    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-podinfo\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642285 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642083    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-envoy\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642285 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642113    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkxg2\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-kube-api-access-hkxg2\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642285 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642153    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istiod-ca-cert\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642285 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642178    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-credential-socket\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642285 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642251    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-socket\") pod \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\" (UID: \"16cafec6-d1f2-4b27-a8b5-7a6756761f12\") "
Jul 29 19:59:03.642590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642396    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:03.642590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642558    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.642590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642577    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:03.642736 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642663    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:59:03.642789 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642743    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:03.642929 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.642906    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-data" (OuterVolumeSpecName: "istio-data") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:03.644445 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.644419    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:03.644653 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.644640    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-token" (OuterVolumeSpecName: "istio-token") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:59:03.644943 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.644923    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:59:03.644999 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.644948    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-kube-api-access-hkxg2" (OuterVolumeSpecName: "kube-api-access-hkxg2") pod "16cafec6-d1f2-4b27-a8b5-7a6756761f12" (UID: "16cafec6-d1f2-4b27-a8b5-7a6756761f12"). InnerVolumeSpecName "kube-api-access-hkxg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:59:03.743780 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743753    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.743780 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743778    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.743966 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743788    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.743966 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743796    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkxg2\" (UniqueName: \"kubernetes.io/projected/16cafec6-d1f2-4b27-a8b5-7a6756761f12-kube-api-access-hkxg2\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.743966 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743805    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.743966 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743812    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.743966 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743822    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.743966 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.743831    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cafec6-d1f2-4b27-a8b5-7a6756761f12-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:03.914542 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.914450    2531 generic.go:356] "Generic (PLEG): container finished" podID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerID="5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a" exitCode=0
Jul 29 19:59:03.914542 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.914502    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"
Jul 29 19:59:03.914715 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.914542    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" event={"ID":"16cafec6-d1f2-4b27-a8b5-7a6756761f12","Type":"ContainerDied","Data":"5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a"}
Jul 29 19:59:03.914715 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.914596    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx" event={"ID":"16cafec6-d1f2-4b27-a8b5-7a6756761f12","Type":"ContainerDied","Data":"957d170e43e84d41fb2fb8281b8b1a5a1d89ba0855f754691225736b6be88f2a"}
Jul 29 19:59:03.914715 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.914619    2531 scope.go:117] "RemoveContainer" containerID="5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a"
Jul 29 19:59:03.923977 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.923959    2531 scope.go:117] "RemoveContainer" containerID="9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544"
Jul 29 19:59:03.932229 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.932181    2531 scope.go:117] "RemoveContainer" containerID="5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a"
Jul 29 19:59:03.932446 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:59:03.932429    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a\": container with ID starting with 5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a not found: ID does not exist" containerID="5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a"
Jul 29 19:59:03.932503 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.932454    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a"} err="failed to get container status \"5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a\": rpc error: code = NotFound desc = could not find container \"5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a\": container with ID starting with 5c1748ca84b5415efe47da66d10bd883e1c3eac64a0ede47b632d642d340570a not found: ID does not exist"
Jul 29 19:59:03.932503 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.932470    2531 scope.go:117] "RemoveContainer" containerID="9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544"
Jul 29 19:59:03.932707 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:59:03.932691    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544\": container with ID starting with 9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544 not found: ID does not exist" containerID="9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544"
Jul 29 19:59:03.932746 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.932715    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544"} err="failed to get container status \"9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544\": rpc error: code = NotFound desc = could not find container \"9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544\": container with ID starting with 9f18ec371a077915df88bee77cc1c745022e7eb302713416c9cc403417821544 not found: ID does not exist"
Jul 29 19:59:03.937676 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.937655    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"]
Jul 29 19:59:03.941462 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:03.941443    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c9fa71cf-openshift-default-7c58cd49bd-mtdhx"]
Jul 29 19:59:04.372283 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:04.372252    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" path="/var/lib/kubelet/pods/16cafec6-d1f2-4b27-a8b5-7a6756761f12/volumes"
Jul 29 19:59:16.125615 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.124968    2531 patch_prober.go:28] interesting pod/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:35556->10.133.0.34:15021: read: connection reset by peer" start-of-body=
Jul 29 19:59:16.125615 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.125076    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": read tcp 10.133.0.2:35556->10.133.0.34:15021: read: connection reset by peer"
Jul 29 19:59:16.979046 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.979015    2531 generic.go:356] "Generic (PLEG): container finished" podID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerID="6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf" exitCode=0
Jul 29 19:59:16.979244 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.979089    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" event={"ID":"2296f45a-5d9a-441d-bbcd-301260ac30f8","Type":"ContainerDied","Data":"6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf"}
Jul 29 19:59:16.979463 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.979450    2531 scope.go:117] "RemoveContainer" containerID="6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf"
Jul 29 19:59:16.980454 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.980427    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:16.980502 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.980493    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:16.980536 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:16.980528    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:17.987928 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:17.987896    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" event={"ID":"2296f45a-5d9a-441d-bbcd-301260ac30f8","Type":"ContainerStarted","Data":"5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18"}
Jul 29 19:59:18.484775 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:18.484737    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:18.485071 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:18.485020    2531 patch_prober.go:28] interesting pod/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 19:59:18.485282 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:18.485254    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 19:59:19.484818 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:19.484781    2531 patch_prober.go:28] interesting pod/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 19:59:19.485411 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:19.485381    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 19:59:20.485284 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:20.485242    2531 patch_prober.go:28] interesting pod/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 19:59:20.485783 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:20.485308    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 19:59:21.484899 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:21.484854    2531 patch_prober.go:28] interesting pod/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 29 19:59:21.485132 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:21.484931    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 29 19:59:22.487935 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:22.487901    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:22.488432 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:22.488247    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:22.488995 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:22.488974    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:26.358681 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.358649    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"]
Jul 29 19:59:26.359092 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.358944    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy"
Jul 29 19:59:26.359092 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.358954    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy"
Jul 29 19:59:26.359092 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.359010    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy"
Jul 29 19:59:26.361777 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.361762    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"
Jul 29 19:59:26.364113 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.364089    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 19:59:26.364223 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.364181    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 19:59:26.373353 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.373332    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"]
Jul 29 19:59:26.436983 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.436957    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e3b189-7a74-482e-b76a-89b61cc609bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh\" (UID: \"00e3b189-7a74-482e-b76a-89b61cc609bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"
Jul 29 19:59:26.538379 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.538327    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e3b189-7a74-482e-b76a-89b61cc609bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh\" (UID: \"00e3b189-7a74-482e-b76a-89b61cc609bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"
Jul 29 19:59:26.538935 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.538913    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e3b189-7a74-482e-b76a-89b61cc609bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh\" (UID: \"00e3b189-7a74-482e-b76a-89b61cc609bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"
Jul 29 19:59:26.673709 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.673631    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"
Jul 29 19:59:26.803003 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:26.802967    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"]
Jul 29 19:59:26.804777 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:59:26.804743    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e3b189_7a74_482e_b76a_89b61cc609bd.slice/crio-50c268dad7be4c4e73222732b801233cf0b4d27deb3cca10156d3067e0114fe5 WatchSource:0}: Error finding container 50c268dad7be4c4e73222732b801233cf0b4d27deb3cca10156d3067e0114fe5: Status 404 returned error can't find the container with id 50c268dad7be4c4e73222732b801233cf0b4d27deb3cca10156d3067e0114fe5
Jul 29 19:59:27.034305 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:27.034273    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh" event={"ID":"00e3b189-7a74-482e-b76a-89b61cc609bd","Type":"ContainerStarted","Data":"cd533fe677742e78f3a780f0e2bbd2a4d00eb9545c1945201e1b30dc46c46932"}
Jul 29 19:59:27.034429 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:27.034321    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh" event={"ID":"00e3b189-7a74-482e-b76a-89b61cc609bd","Type":"ContainerStarted","Data":"50c268dad7be4c4e73222732b801233cf0b4d27deb3cca10156d3067e0114fe5"}
Jul 29 19:59:27.050887 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:27.050838    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh" podStartSLOduration=1.050824938 podStartE2EDuration="1.050824938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:59:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:59:27.049299111 +0000 UTC m=+1775.203557731" watchObservedRunningTime="2026-07-29 19:59:27.050824938 +0000 UTC m=+1775.205083557"
Jul 29 19:59:28.040591 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:28.040554    2531 generic.go:356] "Generic (PLEG): container finished" podID="00e3b189-7a74-482e-b76a-89b61cc609bd" containerID="cd533fe677742e78f3a780f0e2bbd2a4d00eb9545c1945201e1b30dc46c46932" exitCode=0
Jul 29 19:59:28.040968 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:28.040647    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh" event={"ID":"00e3b189-7a74-482e-b76a-89b61cc609bd","Type":"ContainerDied","Data":"cd533fe677742e78f3a780f0e2bbd2a4d00eb9545c1945201e1b30dc46c46932"}
Jul 29 19:59:29.164531 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:29.164507    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"
Jul 29 19:59:29.262411 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:29.262383    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e3b189-7a74-482e-b76a-89b61cc609bd-maas-api-service-ca\") pod \"00e3b189-7a74-482e-b76a-89b61cc609bd\" (UID: \"00e3b189-7a74-482e-b76a-89b61cc609bd\") "
Jul 29 19:59:29.262700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:29.262678    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e3b189-7a74-482e-b76a-89b61cc609bd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00e3b189-7a74-482e-b76a-89b61cc609bd" (UID: "00e3b189-7a74-482e-b76a-89b61cc609bd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:59:29.363855 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:29.363779    2531 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e3b189-7a74-482e-b76a-89b61cc609bd-maas-api-service-ca\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:30.052416 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.052389    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"
Jul 29 19:59:30.052416 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.052399    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh" event={"ID":"00e3b189-7a74-482e-b76a-89b61cc609bd","Type":"ContainerDied","Data":"50c268dad7be4c4e73222732b801233cf0b4d27deb3cca10156d3067e0114fe5"}
Jul 29 19:59:30.052604 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.052448    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50c268dad7be4c4e73222732b801233cf0b4d27deb3cca10156d3067e0114fe5"
Jul 29 19:59:30.186217 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.186179    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"]
Jul 29 19:59:30.193040 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.193013    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fbe86793-6qwkh"]
Jul 29 19:59:30.306534 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.306455    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"]
Jul 29 19:59:30.306690 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.306653    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy" containerID="cri-o://5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18" gracePeriod=30
Jul 29 19:59:30.372408 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:30.372379    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e3b189-7a74-482e-b76a-89b61cc609bd" path="/var/lib/kubelet/pods/00e3b189-7a74-482e-b76a-89b61cc609bd/volumes"
Jul 29 19:59:31.067591 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.067556    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"]
Jul 29 19:59:31.067917 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.067901    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e3b189-7a74-482e-b76a-89b61cc609bd" containerName="revoke-keys"
Jul 29 19:59:31.068025 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.067920    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e3b189-7a74-482e-b76a-89b61cc609bd" containerName="revoke-keys"
Jul 29 19:59:31.068025 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.067946    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy"
Jul 29 19:59:31.068025 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.067955    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy"
Jul 29 19:59:31.068189 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.068036    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e3b189-7a74-482e-b76a-89b61cc609bd" containerName="revoke-keys"
Jul 29 19:59:31.068189 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.068046    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="16cafec6-d1f2-4b27-a8b5-7a6756761f12" containerName="istio-proxy"
Jul 29 19:59:31.071085 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.071042    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.073398 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.073377    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-73e856f2-openshift-default-dockercfg-wtqrd\""
Jul 29 19:59:31.084805 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.084784    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"]
Jul 29 19:59:31.177198 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177169    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-envoy\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177206    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-podinfo\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177278    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pqnw\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-kube-api-access-8pqnw\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177322    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e23649-09ee-45eb-8307-c296fe39b6b9-istiod-ca-cert\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177344    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-credential-socket\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177376 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177362    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-data\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177381    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-socket\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177419    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-certs\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.177590 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.177452    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-token\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.278767 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.278733    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-envoy\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.278774    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-podinfo\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.278808    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pqnw\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-kube-api-access-8pqnw\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.278832    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e23649-09ee-45eb-8307-c296fe39b6b9-istiod-ca-cert\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.278850    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-credential-socket\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.278866    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-data\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.278893    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-socket\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.279070    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-certs\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279206 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.279133    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-token\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279601 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.279286    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-credential-socket\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279601 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.279340    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-socket\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279601 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.279586    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e23649-09ee-45eb-8307-c296fe39b6b9-istiod-ca-cert\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279770 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.279624    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-certs\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.279770 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.279745    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-data\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.281751 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.281725    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-envoy\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.281878 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.281860    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-podinfo\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.293434 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.293409    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-token\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.293515 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.293489    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pqnw\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-kube-api-access-8pqnw\") pod \"e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") " pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.388904 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.388835    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:31.528296 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.528269    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"]
Jul 29 19:59:31.529933 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:59:31.529907    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e23649_09ee_45eb_8307_c296fe39b6b9.slice/crio-6efb1c08c11a37bf596705193ca60644b9520d07f956a46e94f19c3d6294d7b7 WatchSource:0}: Error finding container 6efb1c08c11a37bf596705193ca60644b9520d07f956a46e94f19c3d6294d7b7: Status 404 returned error can't find the container with id 6efb1c08c11a37bf596705193ca60644b9520d07f956a46e94f19c3d6294d7b7
Jul 29 19:59:31.531969 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.531940    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:31.532018 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.532001    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:31.532077 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:31.532028    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:32.063592 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:32.063553    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" event={"ID":"64e23649-09ee-45eb-8307-c296fe39b6b9","Type":"ContainerStarted","Data":"394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4"}
Jul 29 19:59:32.063849 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:32.063615    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" event={"ID":"64e23649-09ee-45eb-8307-c296fe39b6b9","Type":"ContainerStarted","Data":"6efb1c08c11a37bf596705193ca60644b9520d07f956a46e94f19c3d6294d7b7"}
Jul 29 19:59:32.087838 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:32.087792    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" podStartSLOduration=1.087776596 podStartE2EDuration="1.087776596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:59:32.085300236 +0000 UTC m=+1780.239558856" watchObservedRunningTime="2026-07-29 19:59:32.087776596 +0000 UTC m=+1780.242035214"
Jul 29 19:59:32.389700 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:32.389624    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:32.394262 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:32.394238    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:33.068071 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:33.068030    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:33.069001 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:33.068981    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:34.242230 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.242195    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"]
Jul 29 19:59:34.245983 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.245962    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.248731 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.248715    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-73e856f2\""
Jul 29 19:59:34.257127 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.257093    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"]
Jul 29 19:59:34.308083 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.308027    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deaa5158-4455-4853-aff7-5b743b45150b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.308228 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.308208    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ccz\" (UniqueName: \"kubernetes.io/projected/deaa5158-4455-4853-aff7-5b743b45150b-kube-api-access-98ccz\") pod \"payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.409390 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.409359    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deaa5158-4455-4853-aff7-5b743b45150b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.409544 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.409446    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ccz\" (UniqueName: \"kubernetes.io/projected/deaa5158-4455-4853-aff7-5b743b45150b-kube-api-access-98ccz\") pod \"payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.410040 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.410020    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deaa5158-4455-4853-aff7-5b743b45150b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.418377 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.418352    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ccz\" (UniqueName: \"kubernetes.io/projected/deaa5158-4455-4853-aff7-5b743b45150b-kube-api-access-98ccz\") pod \"payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.558247 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.558162    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:34.696941 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:34.696919    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"]
Jul 29 19:59:34.698587 ip-10-0-131-41 kubenswrapper[2531]: W0729 19:59:34.698561    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeaa5158_4455_4853_aff7_5b743b45150b.slice/crio-4388437b919d67158bb0db36bba18b270e182af9f4bbe9188b3172425f54bd62 WatchSource:0}: Error finding container 4388437b919d67158bb0db36bba18b270e182af9f4bbe9188b3172425f54bd62: Status 404 returned error can't find the container with id 4388437b919d67158bb0db36bba18b270e182af9f4bbe9188b3172425f54bd62
Jul 29 19:59:35.080033 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.079992    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh" event={"ID":"deaa5158-4455-4853-aff7-5b743b45150b","Type":"ContainerStarted","Data":"ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6"}
Jul 29 19:59:35.080226 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.080201    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:35.080275 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.080246    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh" event={"ID":"deaa5158-4455-4853-aff7-5b743b45150b","Type":"ContainerStarted","Data":"4388437b919d67158bb0db36bba18b270e182af9f4bbe9188b3172425f54bd62"}
Jul 29 19:59:35.097971 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.097926    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh" podStartSLOduration=1.097911973 podStartE2EDuration="1.097911973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:59:35.096164646 +0000 UTC m=+1783.250423264" watchObservedRunningTime="2026-07-29 19:59:35.097911973 +0000 UTC m=+1783.252170591"
Jul 29 19:59:35.577039 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.576977    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:35.720860 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.720826    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-socket\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721045 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.720883    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-envoy\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721045 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.720919    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-credential-socket\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721045 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.720975    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2296f45a-5d9a-441d-bbcd-301260ac30f8-istiod-ca-cert\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721045 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721015    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-data\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721045 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721041    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-certs\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721346 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721093    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-podinfo\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721346 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721125    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-token\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721346 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721161    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr5kx\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-kube-api-access-sr5kx\") pod \"2296f45a-5d9a-441d-bbcd-301260ac30f8\" (UID: \"2296f45a-5d9a-441d-bbcd-301260ac30f8\") "
Jul 29 19:59:35.721346 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721200    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:35.721545 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721364    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.721545 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721369    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:35.721545 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721480    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2296f45a-5d9a-441d-bbcd-301260ac30f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 19:59:35.721863 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.721769    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:35.722299 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.722270    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:35.723595 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.723566    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 19:59:35.723595 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.723588    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 19:59:35.723745 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.723671    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:59:35.723896 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.723877    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-kube-api-access-sr5kx" (OuterVolumeSpecName: "kube-api-access-sr5kx") pod "2296f45a-5d9a-441d-bbcd-301260ac30f8" (UID: "2296f45a-5d9a-441d-bbcd-301260ac30f8"). InnerVolumeSpecName "kube-api-access-sr5kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 19:59:35.822014 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.821987    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.822014 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.822009    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.822014 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.822018    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2296f45a-5d9a-441d-bbcd-301260ac30f8-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.822264 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.822026    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.822264 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.822034    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2296f45a-5d9a-441d-bbcd-301260ac30f8-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.822264 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.822041    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.822264 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.822048    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:35.822264 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:35.822071    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr5kx\" (UniqueName: \"kubernetes.io/projected/2296f45a-5d9a-441d-bbcd-301260ac30f8-kube-api-access-sr5kx\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 19:59:36.087242 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.087203    2531 generic.go:356] "Generic (PLEG): container finished" podID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerID="5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18" exitCode=0
Jul 29 19:59:36.087478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.087278    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"
Jul 29 19:59:36.087478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.087281    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" event={"ID":"2296f45a-5d9a-441d-bbcd-301260ac30f8","Type":"ContainerDied","Data":"5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18"}
Jul 29 19:59:36.087478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.087357    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm" event={"ID":"2296f45a-5d9a-441d-bbcd-301260ac30f8","Type":"ContainerDied","Data":"f6243b4d3125f1d437c77c7ce6d9694d3f99d7aff1ba8a611a1cbc3fa5ad7c2a"}
Jul 29 19:59:36.087478 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.087386    2531 scope.go:117] "RemoveContainer" containerID="5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18"
Jul 29 19:59:36.096615 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.096599    2531 scope.go:117] "RemoveContainer" containerID="6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf"
Jul 29 19:59:36.104729 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.104712    2531 scope.go:117] "RemoveContainer" containerID="5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18"
Jul 29 19:59:36.104980 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:59:36.104962    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18\": container with ID starting with 5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18 not found: ID does not exist" containerID="5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18"
Jul 29 19:59:36.105034 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.104988    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18"} err="failed to get container status \"5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18\": rpc error: code = NotFound desc = could not find container \"5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18\": container with ID starting with 5f8e1b43794b6a8cb9f98b3f00514f75cad9473fdf790ed2b40175dbdb552b18 not found: ID does not exist"
Jul 29 19:59:36.105034 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.105005    2531 scope.go:117] "RemoveContainer" containerID="6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf"
Jul 29 19:59:36.105243 ip-10-0-131-41 kubenswrapper[2531]: E0729 19:59:36.105227    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf\": container with ID starting with 6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf not found: ID does not exist" containerID="6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf"
Jul 29 19:59:36.105290 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.105246    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf"} err="failed to get container status \"6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf\": rpc error: code = NotFound desc = could not find container \"6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf\": container with ID starting with 6c1e1219282e217b2495fbb2d34a860e2c95329c5e5782b544cf9561d4ada2cf not found: ID does not exist"
Jul 29 19:59:36.111836 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.111812    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"]
Jul 29 19:59:36.117105 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.117086    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-fbe86793-gw-openshift-default-5b588fc7d4-qxsvm"]
Jul 29 19:59:36.371662 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:36.371589    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" path="/var/lib/kubelet/pods/2296f45a-5d9a-441d-bbcd-301260ac30f8/volumes"
Jul 29 19:59:46.090126 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:46.090086    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 19:59:48.070292 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.070201    2531 patch_prober.go:28] interesting pod/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 19:59:48.070292 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.070269    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 19:59:48.148567 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.148534    2531 generic.go:356] "Generic (PLEG): container finished" podID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerID="394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4" exitCode=0
Jul 29 19:59:48.148765 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.148618    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" event={"ID":"64e23649-09ee-45eb-8307-c296fe39b6b9","Type":"ContainerDied","Data":"394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4"}
Jul 29 19:59:48.149099 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.149082    2531 scope.go:117] "RemoveContainer" containerID="394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4"
Jul 29 19:59:48.150101 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.150073    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:48.150194 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.150143    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:48.150194 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:48.150175    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 19:59:49.155688 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:49.155653    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" event={"ID":"64e23649-09ee-45eb-8307-c296fe39b6b9","Type":"ContainerStarted","Data":"fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4"}
Jul 29 19:59:49.389796 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:49.389754    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:49.390277 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:49.390244    2531 patch_prober.go:28] interesting pod/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 19:59:49.390416 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:49.390303    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 19:59:50.390491 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:50.390013    2531 patch_prober.go:28] interesting pod/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 19:59:50.390491 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:50.390101    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 19:59:51.389575 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:51.389535    2531 patch_prober.go:28] interesting pod/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 19:59:51.389865 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:51.389835    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 19:59:52.395079 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:52.390637    2531 patch_prober.go:28] interesting pod/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 29 19:59:52.395079 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:52.390719    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 29 19:59:53.392881 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:53.392851    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:53.393154 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:53.393131    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 19:59:53.393691 ip-10-0-131-41 kubenswrapper[2531]: I0729 19:59:53.393674    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 20:00:00.131167 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.131128    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2"]
Jul 29 20:00:00.131553 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.131455    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy"
Jul 29 20:00:00.131553 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.131466    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy"
Jul 29 20:00:00.131553 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.131482    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy"
Jul 29 20:00:00.131553 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.131488    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy"
Jul 29 20:00:00.131553 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.131535    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy"
Jul 29 20:00:00.133546 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.133522    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2"
Jul 29 20:00:00.135972 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.135954    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 20:00:00.143362 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.143331    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2"]
Jul 29 20:00:00.144517 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.144494    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2"
Jul 29 20:00:00.275370 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:00.275348    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2"]
Jul 29 20:00:00.277298 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:00:00.277265    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd1c66a_dd7b_4132_93d9_d0df6668cb5f.slice/crio-c0e4a2e5e3fedd628483b51912e18b8ff07060ffa81ffd7ac2b1615786d70207 WatchSource:0}: Error finding container c0e4a2e5e3fedd628483b51912e18b8ff07060ffa81ffd7ac2b1615786d70207: Status 404 returned error can't find the container with id c0e4a2e5e3fedd628483b51912e18b8ff07060ffa81ffd7ac2b1615786d70207
Jul 29 20:00:01.220016 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:01.219978    2531 generic.go:356] "Generic (PLEG): container finished" podID="ccd1c66a-dd7b-4132-93d9-d0df6668cb5f" containerID="664502dcec787982462a156b8d67b8375177163ae28752a0daab0dd9836b3b6b" exitCode=0
Jul 29 20:00:01.220479 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:01.220094    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2" event={"ID":"ccd1c66a-dd7b-4132-93d9-d0df6668cb5f","Type":"ContainerDied","Data":"664502dcec787982462a156b8d67b8375177163ae28752a0daab0dd9836b3b6b"}
Jul 29 20:00:01.220479 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:01.220151    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2" event={"ID":"ccd1c66a-dd7b-4132-93d9-d0df6668cb5f","Type":"ContainerStarted","Data":"c0e4a2e5e3fedd628483b51912e18b8ff07060ffa81ffd7ac2b1615786d70207"}
Jul 29 20:00:02.349217 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:02.349195    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2"
Jul 29 20:00:03.231906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:03.231867    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2" event={"ID":"ccd1c66a-dd7b-4132-93d9-d0df6668cb5f","Type":"ContainerDied","Data":"c0e4a2e5e3fedd628483b51912e18b8ff07060ffa81ffd7ac2b1615786d70207"}
Jul 29 20:00:03.232168 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:03.231920    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0e4a2e5e3fedd628483b51912e18b8ff07060ffa81ffd7ac2b1615786d70207"
Jul 29 20:00:03.232168 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:03.231881    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755920-8scn2"
Jul 29 20:00:14.239805 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.239770    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"]
Jul 29 20:00:14.240306 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.240028    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh" podUID="deaa5158-4455-4853-aff7-5b743b45150b" containerName="payload-pre-processing" containerID="cri-o://ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6" gracePeriod=30
Jul 29 20:00:14.495539 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.495484    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 20:00:14.578971 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.578934    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deaa5158-4455-4853-aff7-5b743b45150b-plugins-config-volume\") pod \"deaa5158-4455-4853-aff7-5b743b45150b\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") "
Jul 29 20:00:14.579166 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.579032    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98ccz\" (UniqueName: \"kubernetes.io/projected/deaa5158-4455-4853-aff7-5b743b45150b-kube-api-access-98ccz\") pod \"deaa5158-4455-4853-aff7-5b743b45150b\" (UID: \"deaa5158-4455-4853-aff7-5b743b45150b\") "
Jul 29 20:00:14.579367 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.579338    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deaa5158-4455-4853-aff7-5b743b45150b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "deaa5158-4455-4853-aff7-5b743b45150b" (UID: "deaa5158-4455-4853-aff7-5b743b45150b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:00:14.581256 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.581235    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deaa5158-4455-4853-aff7-5b743b45150b-kube-api-access-98ccz" (OuterVolumeSpecName: "kube-api-access-98ccz") pod "deaa5158-4455-4853-aff7-5b743b45150b" (UID: "deaa5158-4455-4853-aff7-5b743b45150b"). InnerVolumeSpecName "kube-api-access-98ccz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:00:14.679790 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.679758    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ccz\" (UniqueName: \"kubernetes.io/projected/deaa5158-4455-4853-aff7-5b743b45150b-kube-api-access-98ccz\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:14.679790 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:14.679782    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/deaa5158-4455-4853-aff7-5b743b45150b-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:15.292513 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.292470    2531 generic.go:356] "Generic (PLEG): container finished" podID="deaa5158-4455-4853-aff7-5b743b45150b" containerID="ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6" exitCode=0
Jul 29 20:00:15.292949 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.292534    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"
Jul 29 20:00:15.292949 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.292564    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh" event={"ID":"deaa5158-4455-4853-aff7-5b743b45150b","Type":"ContainerDied","Data":"ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6"}
Jul 29 20:00:15.292949 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.292641    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh" event={"ID":"deaa5158-4455-4853-aff7-5b743b45150b","Type":"ContainerDied","Data":"4388437b919d67158bb0db36bba18b270e182af9f4bbe9188b3172425f54bd62"}
Jul 29 20:00:15.292949 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.292663    2531 scope.go:117] "RemoveContainer" containerID="ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6"
Jul 29 20:00:15.301415 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.301398    2531 scope.go:117] "RemoveContainer" containerID="ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6"
Jul 29 20:00:15.301691 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:00:15.301665    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6\": container with ID starting with ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6 not found: ID does not exist" containerID="ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6"
Jul 29 20:00:15.301754 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.301701    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6"} err="failed to get container status \"ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6\": rpc error: code = NotFound desc = could not find container \"ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6\": container with ID starting with ad3592daa49c9023ae0cf1b974bcd093f14a503955d1d93a51d9079c328159d6 not found: ID does not exist"
Jul 29 20:00:15.314284 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.314257    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"]
Jul 29 20:00:15.318379 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.318358    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73e856f2-6c8f958d96-cclgh"]
Jul 29 20:00:15.557504 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.557417    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"]
Jul 29 20:00:15.557664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:15.557624    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy" containerID="cri-o://fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4" gracePeriod=30
Jul 29 20:00:16.276368 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276326    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"]
Jul 29 20:00:16.276626 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276614    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deaa5158-4455-4853-aff7-5b743b45150b" containerName="payload-pre-processing"
Jul 29 20:00:16.276669 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276628    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="deaa5158-4455-4853-aff7-5b743b45150b" containerName="payload-pre-processing"
Jul 29 20:00:16.276669 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276642    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd1c66a-dd7b-4132-93d9-d0df6668cb5f" containerName="cleanup"
Jul 29 20:00:16.276669 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276648    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd1c66a-dd7b-4132-93d9-d0df6668cb5f" containerName="cleanup"
Jul 29 20:00:16.276760 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276704    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd1c66a-dd7b-4132-93d9-d0df6668cb5f" containerName="cleanup"
Jul 29 20:00:16.276760 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276712    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="deaa5158-4455-4853-aff7-5b743b45150b" containerName="payload-pre-processing"
Jul 29 20:00:16.276760 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.276718    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="2296f45a-5d9a-441d-bbcd-301260ac30f8" containerName="istio-proxy"
Jul 29 20:00:16.280947 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.280932    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.283672 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.283650    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2e1a0620-openshift-default-dockercfg-5bwnd\""
Jul 29 20:00:16.294837 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.294811    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"]
Jul 29 20:00:16.373202 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.373167    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deaa5158-4455-4853-aff7-5b743b45150b" path="/var/lib/kubelet/pods/deaa5158-4455-4853-aff7-5b743b45150b/volumes"
Jul 29 20:00:16.394264 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394233    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istiod-ca-cert\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394264 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394270    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn79b\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-kube-api-access-wn79b\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394462 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394315    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-envoy\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394462 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394375    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-certs\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394462 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394403    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-socket\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394462 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394421    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-podinfo\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394462 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394437    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-data\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394619 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394482    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-credential-socket\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.394619 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.394514    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-token\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.495822 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.495790    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-certs\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.495994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.495830    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-socket\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.495994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.495856    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-podinfo\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.495994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.495882    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-data\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.495994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.495905    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-credential-socket\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.495994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.495934    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-token\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496264 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496006    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istiod-ca-cert\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496264 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496040    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn79b\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-kube-api-access-wn79b\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496268    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-socket\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496303    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-certs\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496489 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496434    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-envoy\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496489 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496474    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-data\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496586 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496523    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-credential-socket\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.496693 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.496674    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istiod-ca-cert\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.498709 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.498691    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-envoy\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.498803 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.498734    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-podinfo\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.506810 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.506774    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn79b\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-kube-api-access-wn79b\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.507099 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.507075    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-token\") pod \"e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") " pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.591722 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.591630    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:16.728738 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.728715    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"]
Jul 29 20:00:16.730337 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:00:16.730309    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812a66ff_220c_4d38_8aa3_74c8bb7bd425.slice/crio-e05e2f49bad025c073e3950ca8b3992d25373c54e273738a3bf2e6e633364bdb WatchSource:0}: Error finding container e05e2f49bad025c073e3950ca8b3992d25373c54e273738a3bf2e6e633364bdb: Status 404 returned error can't find the container with id e05e2f49bad025c073e3950ca8b3992d25373c54e273738a3bf2e6e633364bdb
Jul 29 20:00:16.732345 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.732313    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:00:16.732615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.732596    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:00:16.732659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:16.732635    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:00:17.313280 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:17.313241    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" event={"ID":"812a66ff-220c-4d38-8aa3-74c8bb7bd425","Type":"ContainerStarted","Data":"9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794"}
Jul 29 20:00:17.313678 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:17.313323    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" event={"ID":"812a66ff-220c-4d38-8aa3-74c8bb7bd425","Type":"ContainerStarted","Data":"e05e2f49bad025c073e3950ca8b3992d25373c54e273738a3bf2e6e633364bdb"}
Jul 29 20:00:17.335945 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:17.335896    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podStartSLOduration=1.335880266 podStartE2EDuration="1.335880266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:00:17.333157017 +0000 UTC m=+1825.487415637" watchObservedRunningTime="2026-07-29 20:00:17.335880266 +0000 UTC m=+1825.490138884"
Jul 29 20:00:17.592378 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:17.592285    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:17.597265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:17.597239    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:18.319027 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:18.318999    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:18.320090 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:18.320070    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:20.806772 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.806750    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 20:00:20.938370 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938345    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-podinfo\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938381    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-envoy\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938426    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pqnw\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-kube-api-access-8pqnw\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938459    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e23649-09ee-45eb-8307-c296fe39b6b9-istiod-ca-cert\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938476    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-data\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938496    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-credential-socket\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938541    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-certs\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938860 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938591    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-socket\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938860 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938614    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-token\") pod \"64e23649-09ee-45eb-8307-c296fe39b6b9\" (UID: \"64e23649-09ee-45eb-8307-c296fe39b6b9\") "
Jul 29 20:00:20.938860 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938825    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:20.939005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.938951    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:20.939093 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.939010    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e23649-09ee-45eb-8307-c296fe39b6b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:00:20.939093 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.939040    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:20.939620 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.939592    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:20.940810 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.940777    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:00:20.940810 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.940798    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:00:20.940810 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.940795    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:20.940963 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:20.940906    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-kube-api-access-8pqnw" (OuterVolumeSpecName: "kube-api-access-8pqnw") pod "64e23649-09ee-45eb-8307-c296fe39b6b9" (UID: "64e23649-09ee-45eb-8307-c296fe39b6b9"). InnerVolumeSpecName "kube-api-access-8pqnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:00:21.039521 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039487    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039521 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039515    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039521 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039523    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039521 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039531    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039784 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039539    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039784 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039547    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pqnw\" (UniqueName: \"kubernetes.io/projected/64e23649-09ee-45eb-8307-c296fe39b6b9-kube-api-access-8pqnw\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039784 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039556    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e23649-09ee-45eb-8307-c296fe39b6b9-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039784 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039564    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.039784 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.039572    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e23649-09ee-45eb-8307-c296fe39b6b9-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:21.333959 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.333875    2531 generic.go:356] "Generic (PLEG): container finished" podID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerID="fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4" exitCode=0
Jul 29 20:00:21.333959 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.333925    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"
Jul 29 20:00:21.334167 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.333960    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" event={"ID":"64e23649-09ee-45eb-8307-c296fe39b6b9","Type":"ContainerDied","Data":"fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4"}
Jul 29 20:00:21.334167 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.334013    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl" event={"ID":"64e23649-09ee-45eb-8307-c296fe39b6b9","Type":"ContainerDied","Data":"6efb1c08c11a37bf596705193ca60644b9520d07f956a46e94f19c3d6294d7b7"}
Jul 29 20:00:21.334167 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.334035    2531 scope.go:117] "RemoveContainer" containerID="fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4"
Jul 29 20:00:21.343884 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.343868    2531 scope.go:117] "RemoveContainer" containerID="394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4"
Jul 29 20:00:21.354307 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.354288    2531 scope.go:117] "RemoveContainer" containerID="fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4"
Jul 29 20:00:21.354555 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:00:21.354525    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4\": container with ID starting with fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4 not found: ID does not exist" containerID="fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4"
Jul 29 20:00:21.354599 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.354564    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4"} err="failed to get container status \"fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4\": rpc error: code = NotFound desc = could not find container \"fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4\": container with ID starting with fb7bf5ac9f9e83218e73b854fab1a2abf59021b7bd3fdc1e78c6e2746e84dbd4 not found: ID does not exist"
Jul 29 20:00:21.354599 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.354582    2531 scope.go:117] "RemoveContainer" containerID="394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4"
Jul 29 20:00:21.354800 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:00:21.354787    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4\": container with ID starting with 394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4 not found: ID does not exist" containerID="394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4"
Jul 29 20:00:21.354838 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.354805    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4"} err="failed to get container status \"394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4\": rpc error: code = NotFound desc = could not find container \"394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4\": container with ID starting with 394aba8e14591776f7b853edbe964bbca91574b49e0d305dcd63a20f00ff0ba4 not found: ID does not exist"
Jul 29 20:00:21.358448 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.358427    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"]
Jul 29 20:00:21.362524 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:21.362506    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-73e856f2-openshift-default-79b7d8c756-6shpl"]
Jul 29 20:00:22.371109 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:22.371049    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" path="/var/lib/kubelet/pods/64e23649-09ee-45eb-8307-c296fe39b6b9/volumes"
Jul 29 20:00:33.321029 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.320988    2531 patch_prober.go:28] interesting pod/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 20:00:33.321499 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.321078    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 20:00:33.406161 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.406120    2531 generic.go:356] "Generic (PLEG): container finished" podID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerID="9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794" exitCode=0
Jul 29 20:00:33.406322 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.406194    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" event={"ID":"812a66ff-220c-4d38-8aa3-74c8bb7bd425","Type":"ContainerDied","Data":"9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794"}
Jul 29 20:00:33.406588 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.406569    2531 scope.go:117] "RemoveContainer" containerID="9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794"
Jul 29 20:00:33.407575 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.407544    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:00:33.407654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.407637    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:00:33.407690 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:33.407681    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:00:34.413416 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:34.413377    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" event={"ID":"812a66ff-220c-4d38-8aa3-74c8bb7bd425","Type":"ContainerStarted","Data":"9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8"}
Jul 29 20:00:34.592182 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:34.592086    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:34.592679 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:34.592381    2531 patch_prober.go:28] interesting pod/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 20:00:34.592679 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:34.592434    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 20:00:35.592213 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:35.592156    2531 patch_prober.go:28] interesting pod/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 20:00:35.592712 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:35.592240    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 20:00:36.592453 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:36.592413    2531 patch_prober.go:28] interesting pod/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 20:00:36.593467 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:36.593023    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 20:00:37.591947 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:37.591899    2531 patch_prober.go:28] interesting pod/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 29 20:00:37.592185 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:37.591970    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 29 20:00:38.596245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:38.596214    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:38.596675 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:38.596473    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:38.597012 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:38.596995    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:43.516278 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.516243    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"]
Jul 29 20:00:43.516767 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.516664    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy"
Jul 29 20:00:43.516767 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.516682    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy"
Jul 29 20:00:43.516767 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.516697    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy"
Jul 29 20:00:43.516767 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.516705    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy"
Jul 29 20:00:43.516974 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.516771    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy"
Jul 29 20:00:43.516974 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.516783    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e23649-09ee-45eb-8307-c296fe39b6b9" containerName="istio-proxy"
Jul 29 20:00:43.519360 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.519341    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"
Jul 29 20:00:43.521638 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.521618    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 20:00:43.521728 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.521668    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:00:43.527339 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.527316    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"]
Jul 29 20:00:43.644996 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.644956    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f1e86bd-bc2c-407e-bea6-1ecb65c57054-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2e1a0620-22klc\" (UID: \"5f1e86bd-bc2c-407e-bea6-1ecb65c57054\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"
Jul 29 20:00:43.745823 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.745783    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f1e86bd-bc2c-407e-bea6-1ecb65c57054-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2e1a0620-22klc\" (UID: \"5f1e86bd-bc2c-407e-bea6-1ecb65c57054\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"
Jul 29 20:00:43.746476 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.746454    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f1e86bd-bc2c-407e-bea6-1ecb65c57054-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2e1a0620-22klc\" (UID: \"5f1e86bd-bc2c-407e-bea6-1ecb65c57054\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"
Jul 29 20:00:43.831292 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.831200    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"
Jul 29 20:00:43.963416 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:43.963353    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"]
Jul 29 20:00:43.965598 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:00:43.965568    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1e86bd_bc2c_407e_bea6_1ecb65c57054.slice/crio-511da52a9096dc7a715c92286ec46c80c49b27d2058d1b755b3d3c87ea4f3429 WatchSource:0}: Error finding container 511da52a9096dc7a715c92286ec46c80c49b27d2058d1b755b3d3c87ea4f3429: Status 404 returned error can't find the container with id 511da52a9096dc7a715c92286ec46c80c49b27d2058d1b755b3d3c87ea4f3429
Jul 29 20:00:44.461352 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:44.461249    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc" event={"ID":"5f1e86bd-bc2c-407e-bea6-1ecb65c57054","Type":"ContainerStarted","Data":"a13a8c4d2229f56a4123001eac2654bb2f17871845d7bf84f2f07509fed3aba2"}
Jul 29 20:00:44.461352 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:44.461310    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc" event={"ID":"5f1e86bd-bc2c-407e-bea6-1ecb65c57054","Type":"ContainerStarted","Data":"511da52a9096dc7a715c92286ec46c80c49b27d2058d1b755b3d3c87ea4f3429"}
Jul 29 20:00:44.479508 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:44.479458    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc" podStartSLOduration=1.479439 podStartE2EDuration="1.479439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:00:44.477757574 +0000 UTC m=+1852.632016198" watchObservedRunningTime="2026-07-29 20:00:44.479439 +0000 UTC m=+1852.633697618"
Jul 29 20:00:45.467554 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:45.467520    2531 generic.go:356] "Generic (PLEG): container finished" podID="5f1e86bd-bc2c-407e-bea6-1ecb65c57054" containerID="a13a8c4d2229f56a4123001eac2654bb2f17871845d7bf84f2f07509fed3aba2" exitCode=0
Jul 29 20:00:45.467554 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:45.467555    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc" event={"ID":"5f1e86bd-bc2c-407e-bea6-1ecb65c57054","Type":"ContainerDied","Data":"a13a8c4d2229f56a4123001eac2654bb2f17871845d7bf84f2f07509fed3aba2"}
Jul 29 20:00:46.605536 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:46.605512    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"
Jul 29 20:00:46.672588 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:46.672559    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f1e86bd-bc2c-407e-bea6-1ecb65c57054-maas-api-service-ca\") pod \"5f1e86bd-bc2c-407e-bea6-1ecb65c57054\" (UID: \"5f1e86bd-bc2c-407e-bea6-1ecb65c57054\") "
Jul 29 20:00:46.672902 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:46.672880    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1e86bd-bc2c-407e-bea6-1ecb65c57054-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f1e86bd-bc2c-407e-bea6-1ecb65c57054" (UID: "5f1e86bd-bc2c-407e-bea6-1ecb65c57054"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:00:46.774028 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:46.773948    2531 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f1e86bd-bc2c-407e-bea6-1ecb65c57054-maas-api-service-ca\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:47.478349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:47.478320    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"
Jul 29 20:00:47.478497 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:47.478368    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc" event={"ID":"5f1e86bd-bc2c-407e-bea6-1ecb65c57054","Type":"ContainerDied","Data":"511da52a9096dc7a715c92286ec46c80c49b27d2058d1b755b3d3c87ea4f3429"}
Jul 29 20:00:47.478497 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:47.478415    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="511da52a9096dc7a715c92286ec46c80c49b27d2058d1b755b3d3c87ea4f3429"
Jul 29 20:00:49.825609 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:49.825578    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"]
Jul 29 20:00:49.828490 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:49.828461    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2e1a0620-22klc"]
Jul 29 20:00:49.954399 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:49.954366    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"]
Jul 29 20:00:49.954626 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:49.954600    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy" containerID="cri-o://9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8" gracePeriod=30
Jul 29 20:00:50.371290 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:50.371249    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f1e86bd-bc2c-407e-bea6-1ecb65c57054" path="/var/lib/kubelet/pods/5f1e86bd-bc2c-407e-bea6-1ecb65c57054/volumes"
Jul 29 20:00:53.598867 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:53.598824    2531 patch_prober.go:28] interesting pod/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 20:00:53.599278 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:53.598909    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:00:55.206739 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.206716    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:55.345166 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345087    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istiod-ca-cert\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345166 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345124    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn79b\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-kube-api-access-wn79b\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345166 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345143    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-data\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345166 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345160    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-certs\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345197    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-credential-socket\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345216    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-podinfo\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345236    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-token\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345273    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-envoy\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345298    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-socket\") pod \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\" (UID: \"812a66ff-220c-4d38-8aa3-74c8bb7bd425\") "
Jul 29 20:00:55.345683 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345557    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:55.345683 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345568    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:55.345762 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345711    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:55.345762 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.345659    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:00:55.346547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.346517    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-data" (OuterVolumeSpecName: "istio-data") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:55.347510 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.347481    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-kube-api-access-wn79b" (OuterVolumeSpecName: "kube-api-access-wn79b") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "kube-api-access-wn79b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:00:55.347719 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.347694    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:00:55.347809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.347752    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:00:55.347809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.347776    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-token" (OuterVolumeSpecName: "istio-token") pod "812a66ff-220c-4d38-8aa3-74c8bb7bd425" (UID: "812a66ff-220c-4d38-8aa3-74c8bb7bd425"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:00:55.446923 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446887    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.446923 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446917    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn79b\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-kube-api-access-wn79b\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.446923 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446930    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.447203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446942    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.447203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446953    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.447203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446963    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.447203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446974    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.447203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446984    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.447203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.446996    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/812a66ff-220c-4d38-8aa3-74c8bb7bd425-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:00:55.518142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.518111    2531 generic.go:356] "Generic (PLEG): container finished" podID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerID="9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8" exitCode=0
Jul 29 20:00:55.518271 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.518162    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"
Jul 29 20:00:55.518271 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.518202    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" event={"ID":"812a66ff-220c-4d38-8aa3-74c8bb7bd425","Type":"ContainerDied","Data":"9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8"}
Jul 29 20:00:55.518271 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.518255    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp" event={"ID":"812a66ff-220c-4d38-8aa3-74c8bb7bd425","Type":"ContainerDied","Data":"e05e2f49bad025c073e3950ca8b3992d25373c54e273738a3bf2e6e633364bdb"}
Jul 29 20:00:55.518390 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.518283    2531 scope.go:117] "RemoveContainer" containerID="9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8"
Jul 29 20:00:55.527640 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.527625    2531 scope.go:117] "RemoveContainer" containerID="9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794"
Jul 29 20:00:55.535626 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.535606    2531 scope.go:117] "RemoveContainer" containerID="9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8"
Jul 29 20:00:55.535851 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:00:55.535833    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8\": container with ID starting with 9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8 not found: ID does not exist" containerID="9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8"
Jul 29 20:00:55.535899 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.535859    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8"} err="failed to get container status \"9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8\": rpc error: code = NotFound desc = could not find container \"9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8\": container with ID starting with 9a82612eb0884f05888d66cf31243000d4906b68a21d4f8838bd6c3a190e13a8 not found: ID does not exist"
Jul 29 20:00:55.535899 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.535873    2531 scope.go:117] "RemoveContainer" containerID="9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794"
Jul 29 20:00:55.536119 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:00:55.536098    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794\": container with ID starting with 9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794 not found: ID does not exist" containerID="9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794"
Jul 29 20:00:55.536189 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.536128    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794"} err="failed to get container status \"9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794\": rpc error: code = NotFound desc = could not find container \"9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794\": container with ID starting with 9bc8e144ce01baf399b31300a93dd2935afcf841bfb7d3f7f648dde7ee1f9794 not found: ID does not exist"
Jul 29 20:00:55.540226 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.540203    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"]
Jul 29 20:00:55.544490 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:55.544469    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2e1a0620-openshift-default-786b76c7d8-nb8gp"]
Jul 29 20:00:56.371230 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:00:56.371197    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" path="/var/lib/kubelet/pods/812a66ff-220c-4d38-8aa3-74c8bb7bd425/volumes"
Jul 29 20:02:39.086134 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086098    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"]
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086374    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1e86bd-bc2c-407e-bea6-1ecb65c57054" containerName="revoke-keys"
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086408    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1e86bd-bc2c-407e-bea6-1ecb65c57054" containerName="revoke-keys"
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086424    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy"
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086433    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy"
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086448    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy"
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086453    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy"
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086496    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy"
Jul 29 20:02:39.086617 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.086508    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1e86bd-bc2c-407e-bea6-1ecb65c57054" containerName="revoke-keys"
Jul 29 20:02:39.089223 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.089201    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.091579 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.091557    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f42b0d30-openshift-default-dockercfg-slbfh\""
Jul 29 20:02:39.110757 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.110731    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"]
Jul 29 20:02:39.195944 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.195911    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-credential-socket\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.195944 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.195948    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-envoy\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.196174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.195974    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-data\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.196174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.196012    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-istio-token\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.196174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.196044    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-socket\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.196174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.196152    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761d657f-92b1-49f6-b35a-d51875bf0222-istiod-ca-cert\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.196301 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.196184    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qg87\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-kube-api-access-6qg87\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.196301 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.196224    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-certs\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.196301 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.196242    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761d657f-92b1-49f6-b35a-d51875bf0222-istio-podinfo\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297364 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297335    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-socket\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297537 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297383    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761d657f-92b1-49f6-b35a-d51875bf0222-istiod-ca-cert\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297537 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297401    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qg87\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-kube-api-access-6qg87\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297537 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297424    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-certs\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297537 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297482    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761d657f-92b1-49f6-b35a-d51875bf0222-istio-podinfo\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297780 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297543    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-credential-socket\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297780 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297572    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-envoy\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297780 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297600    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-data\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297780 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297628    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-istio-token\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297986 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297839    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-certs\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.297986 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.297942    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-credential-socket\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.298086 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.298007    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-data\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.298131 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.298105    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-socket\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.298219 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.298202    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761d657f-92b1-49f6-b35a-d51875bf0222-istiod-ca-cert\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.299881 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.299861    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-envoy\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.300011 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.299993    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761d657f-92b1-49f6-b35a-d51875bf0222-istio-podinfo\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.306504 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.306443    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-istio-token\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.306622 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.306566    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qg87\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-kube-api-access-6qg87\") pod \"e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") " pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.398316 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.398239    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:39.533664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.533639    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"]
Jul 29 20:02:39.535591 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:02:39.535564    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761d657f_92b1_49f6_b35a_d51875bf0222.slice/crio-813c2f5bdb9af2997f4309b61b92c139e385fba399ccfd51054c19d1b4526974 WatchSource:0}: Error finding container 813c2f5bdb9af2997f4309b61b92c139e385fba399ccfd51054c19d1b4526974: Status 404 returned error can't find the container with id 813c2f5bdb9af2997f4309b61b92c139e385fba399ccfd51054c19d1b4526974
Jul 29 20:02:39.540229 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.540190    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:02:39.540359 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.540263    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:02:39.540359 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:39.540300    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:02:40.006511 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:40.006471    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" event={"ID":"761d657f-92b1-49f6-b35a-d51875bf0222","Type":"ContainerStarted","Data":"994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a"}
Jul 29 20:02:40.006687 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:40.006525    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" event={"ID":"761d657f-92b1-49f6-b35a-d51875bf0222","Type":"ContainerStarted","Data":"813c2f5bdb9af2997f4309b61b92c139e385fba399ccfd51054c19d1b4526974"}
Jul 29 20:02:40.038402 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:40.038346    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" podStartSLOduration=1.038329284 podStartE2EDuration="1.038329284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:02:40.036194076 +0000 UTC m=+1968.190452707" watchObservedRunningTime="2026-07-29 20:02:40.038329284 +0000 UTC m=+1968.192587902"
Jul 29 20:02:40.398619 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:40.398541    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:40.403255 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:40.403231    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:41.011203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:41.011175    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:41.012098 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:41.012046    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:42.799504 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.799469    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"]
Jul 29 20:02:42.799886 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.799802    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="812a66ff-220c-4d38-8aa3-74c8bb7bd425" containerName="istio-proxy"
Jul 29 20:02:42.802659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.802645    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:42.804998 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.804972    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f42b0d30\""
Jul 29 20:02:42.805155 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.805028    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f42b0d30-dockercfg-69xfx\""
Jul 29 20:02:42.811936 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.811915    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"]
Jul 29 20:02:42.929718 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.929679    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e4842ce-646d-4d47-b9ae-10a1fd94134a-plugins-config-volume\") pod \"payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") " pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:42.929902 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:42.929737    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69ng\" (UniqueName: \"kubernetes.io/projected/4e4842ce-646d-4d47-b9ae-10a1fd94134a-kube-api-access-x69ng\") pod \"payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") " pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:43.030287 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:43.030250    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e4842ce-646d-4d47-b9ae-10a1fd94134a-plugins-config-volume\") pod \"payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") " pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:43.030484 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:43.030305    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69ng\" (UniqueName: \"kubernetes.io/projected/4e4842ce-646d-4d47-b9ae-10a1fd94134a-kube-api-access-x69ng\") pod \"payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") " pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:43.030950 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:43.030929    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e4842ce-646d-4d47-b9ae-10a1fd94134a-plugins-config-volume\") pod \"payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") " pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:43.041399 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:43.041374    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69ng\" (UniqueName: \"kubernetes.io/projected/4e4842ce-646d-4d47-b9ae-10a1fd94134a-kube-api-access-x69ng\") pod \"payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") " pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:43.113822 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:43.113717    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:43.250925 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:43.250882    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"]
Jul 29 20:02:43.253112 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:02:43.253080    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4842ce_646d_4d47_b9ae_10a1fd94134a.slice/crio-fcb8e54dd46f59881ae62a6837b0b2c3845464897c4f86daa5ff12160e58ac43 WatchSource:0}: Error finding container fcb8e54dd46f59881ae62a6837b0b2c3845464897c4f86daa5ff12160e58ac43: Status 404 returned error can't find the container with id fcb8e54dd46f59881ae62a6837b0b2c3845464897c4f86daa5ff12160e58ac43
Jul 29 20:02:44.026405 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:44.026369    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk" event={"ID":"4e4842ce-646d-4d47-b9ae-10a1fd94134a","Type":"ContainerStarted","Data":"ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364"}
Jul 29 20:02:44.026791 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:44.026423    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk" event={"ID":"4e4842ce-646d-4d47-b9ae-10a1fd94134a","Type":"ContainerStarted","Data":"fcb8e54dd46f59881ae62a6837b0b2c3845464897c4f86daa5ff12160e58ac43"}
Jul 29 20:02:44.026791 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:44.026451    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:44.050656 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:44.050511    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk" podStartSLOduration=2.050494584 podStartE2EDuration="2.050494584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:02:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:02:44.049843793 +0000 UTC m=+1972.204102415" watchObservedRunningTime="2026-07-29 20:02:44.050494584 +0000 UTC m=+1972.204753204"
Jul 29 20:02:55.033393 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:55.033355    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:02:56.013461 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.013417    2531 patch_prober.go:28] interesting pod/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 29 20:02:56.013672 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.013488    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 29 20:02:56.088305 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.088275    2531 generic.go:356] "Generic (PLEG): container finished" podID="761d657f-92b1-49f6-b35a-d51875bf0222" containerID="994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a" exitCode=0
Jul 29 20:02:56.088715 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.088354    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" event={"ID":"761d657f-92b1-49f6-b35a-d51875bf0222","Type":"ContainerDied","Data":"994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a"}
Jul 29 20:02:56.088773 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.088718    2531 scope.go:117] "RemoveContainer" containerID="994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a"
Jul 29 20:02:56.089685 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.089650    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:02:56.089799 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.089715    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:02:56.089799 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:56.089751    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:02:57.098531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:57.098485    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" event={"ID":"761d657f-92b1-49f6-b35a-d51875bf0222","Type":"ContainerStarted","Data":"35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4"}
Jul 29 20:02:57.398483 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:57.398389    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:02:57.398647 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:57.398623    2531 patch_prober.go:28] interesting pod/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 29 20:02:57.398708 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:57.398688    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 29 20:02:58.398589 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:58.398547    2531 patch_prober.go:28] interesting pod/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 29 20:02:58.399109 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:58.398606    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 29 20:02:59.399621 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:59.399584    2531 patch_prober.go:28] interesting pod/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 29 20:02:59.400032 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:02:59.399646    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 29 20:03:00.399149 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:00.399111    2531 patch_prober.go:28] interesting pod/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 29 20:03:00.399334 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:00.399177    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 29 20:03:01.403198 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:01.403163    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:03:01.403599 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:01.403452    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:03:01.404232 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:01.404215    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:03:24.891086 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:24.891032    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"]
Jul 29 20:03:24.891654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:24.891261    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk" podUID="4e4842ce-646d-4d47-b9ae-10a1fd94134a" containerName="payload-processing" containerID="cri-o://ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364" gracePeriod=30
Jul 29 20:03:25.031877 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.031830    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk" podUID="4e4842ce-646d-4d47-b9ae-10a1fd94134a" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.42:9004: connect: connection refused"
Jul 29 20:03:25.148306 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.148255    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:03:25.217138 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.217108    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e4842ce-646d-4d47-b9ae-10a1fd94134a-plugins-config-volume\") pod \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") "
Jul 29 20:03:25.217317 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.217155    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x69ng\" (UniqueName: \"kubernetes.io/projected/4e4842ce-646d-4d47-b9ae-10a1fd94134a-kube-api-access-x69ng\") pod \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\" (UID: \"4e4842ce-646d-4d47-b9ae-10a1fd94134a\") "
Jul 29 20:03:25.217544 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.217516    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e4842ce-646d-4d47-b9ae-10a1fd94134a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e4842ce-646d-4d47-b9ae-10a1fd94134a" (UID: "4e4842ce-646d-4d47-b9ae-10a1fd94134a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:03:25.219437 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.219416    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4842ce-646d-4d47-b9ae-10a1fd94134a-kube-api-access-x69ng" (OuterVolumeSpecName: "kube-api-access-x69ng") pod "4e4842ce-646d-4d47-b9ae-10a1fd94134a" (UID: "4e4842ce-646d-4d47-b9ae-10a1fd94134a"). InnerVolumeSpecName "kube-api-access-x69ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:03:25.232895 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.232869    2531 generic.go:356] "Generic (PLEG): container finished" podID="4e4842ce-646d-4d47-b9ae-10a1fd94134a" containerID="ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364" exitCode=0
Jul 29 20:03:25.233006 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.232913    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"
Jul 29 20:03:25.233006 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.232948    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk" event={"ID":"4e4842ce-646d-4d47-b9ae-10a1fd94134a","Type":"ContainerDied","Data":"ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364"}
Jul 29 20:03:25.233006 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.233002    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk" event={"ID":"4e4842ce-646d-4d47-b9ae-10a1fd94134a","Type":"ContainerDied","Data":"fcb8e54dd46f59881ae62a6837b0b2c3845464897c4f86daa5ff12160e58ac43"}
Jul 29 20:03:25.233136 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.233026    2531 scope.go:117] "RemoveContainer" containerID="ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364"
Jul 29 20:03:25.242162 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.242146    2531 scope.go:117] "RemoveContainer" containerID="ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364"
Jul 29 20:03:25.242403 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:03:25.242384    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364\": container with ID starting with ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364 not found: ID does not exist" containerID="ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364"
Jul 29 20:03:25.242461 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.242411    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364"} err="failed to get container status \"ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364\": rpc error: code = NotFound desc = could not find container \"ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364\": container with ID starting with ea4c53f9f5199d659f14937ceddf341e271441ef3239ea49ab166c6497903364 not found: ID does not exist"
Jul 29 20:03:25.260156 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.260131    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"]
Jul 29 20:03:25.265400 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.265378    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f42b0d30-549f6b6c94-7jlfk"]
Jul 29 20:03:25.318436 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.318408    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x69ng\" (UniqueName: \"kubernetes.io/projected/4e4842ce-646d-4d47-b9ae-10a1fd94134a-kube-api-access-x69ng\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:25.318436 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:25.318433    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e4842ce-646d-4d47-b9ae-10a1fd94134a-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:26.372015 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:26.371984    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e4842ce-646d-4d47-b9ae-10a1fd94134a" path="/var/lib/kubelet/pods/4e4842ce-646d-4d47-b9ae-10a1fd94134a/volumes"
Jul 29 20:03:31.798807 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:31.798778    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"]
Jul 29 20:03:31.799264 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:31.798966    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy" containerID="cri-o://35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4" gracePeriod=30
Jul 29 20:03:37.052458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.052432    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:03:37.219110 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219079    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-certs\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219127    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-envoy\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219160    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-istio-token\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219184    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-credential-socket\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219216    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761d657f-92b1-49f6-b35a-d51875bf0222-istiod-ca-cert\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219237    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-data\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219260    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761d657f-92b1-49f6-b35a-d51875bf0222-istio-podinfo\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219591 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219299    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qg87\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-kube-api-access-6qg87\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219591 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219340    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-socket\") pod \"761d657f-92b1-49f6-b35a-d51875bf0222\" (UID: \"761d657f-92b1-49f6-b35a-d51875bf0222\") "
Jul 29 20:03:37.219591 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219369    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:03:37.219591 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219541    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.219809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219634    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/761d657f-92b1-49f6-b35a-d51875bf0222-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:03:37.219809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219697    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:03:37.219922 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.219807    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:03:37.220245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.220219    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-data" (OuterVolumeSpecName: "istio-data") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:03:37.221676 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.221653    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/761d657f-92b1-49f6-b35a-d51875bf0222-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:03:37.221676 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.221662    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-istio-token" (OuterVolumeSpecName: "istio-token") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:03:37.221997 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.221975    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:03:37.222038 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.221979    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-kube-api-access-6qg87" (OuterVolumeSpecName: "kube-api-access-6qg87") pod "761d657f-92b1-49f6-b35a-d51875bf0222" (UID: "761d657f-92b1-49f6-b35a-d51875bf0222"). InnerVolumeSpecName "kube-api-access-6qg87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:03:37.290542 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.290510    2531 generic.go:356] "Generic (PLEG): container finished" podID="761d657f-92b1-49f6-b35a-d51875bf0222" containerID="35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4" exitCode=0
Jul 29 20:03:37.290542 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.290545    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" event={"ID":"761d657f-92b1-49f6-b35a-d51875bf0222","Type":"ContainerDied","Data":"35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4"}
Jul 29 20:03:37.290753 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.290556    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"
Jul 29 20:03:37.290753 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.290584    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh" event={"ID":"761d657f-92b1-49f6-b35a-d51875bf0222","Type":"ContainerDied","Data":"813c2f5bdb9af2997f4309b61b92c139e385fba399ccfd51054c19d1b4526974"}
Jul 29 20:03:37.290753 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.290604    2531 scope.go:117] "RemoveContainer" containerID="35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4"
Jul 29 20:03:37.299841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.299826    2531 scope.go:117] "RemoveContainer" containerID="994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a"
Jul 29 20:03:37.307836 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.307815    2531 scope.go:117] "RemoveContainer" containerID="35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4"
Jul 29 20:03:37.308116 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:03:37.308098    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4\": container with ID starting with 35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4 not found: ID does not exist" containerID="35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4"
Jul 29 20:03:37.308168 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.308126    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4"} err="failed to get container status \"35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4\": rpc error: code = NotFound desc = could not find container \"35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4\": container with ID starting with 35690f82bc11c5b517edcd15c35ae5e6d8c5e7a96dcd2e70fb6a35df455559a4 not found: ID does not exist"
Jul 29 20:03:37.308168 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.308142    2531 scope.go:117] "RemoveContainer" containerID="994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a"
Jul 29 20:03:37.308382 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:03:37.308363    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a\": container with ID starting with 994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a not found: ID does not exist" containerID="994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a"
Jul 29 20:03:37.308420 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.308390    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a"} err="failed to get container status \"994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a\": rpc error: code = NotFound desc = could not find container \"994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a\": container with ID starting with 994aba5cbc973509d52abf60805a56f286bfcd60d754d13003eaae030bd7fa5a not found: ID does not exist"
Jul 29 20:03:37.316400 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.316377    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"]
Jul 29 20:03:37.320132 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320111    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320132 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320133    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320143    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320151    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/761d657f-92b1-49f6-b35a-d51875bf0222-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320160    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320167    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/761d657f-92b1-49f6-b35a-d51875bf0222-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320175    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qg87\" (UniqueName: \"kubernetes.io/projected/761d657f-92b1-49f6-b35a-d51875bf0222-kube-api-access-6qg87\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320182    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/761d657f-92b1-49f6-b35a-d51875bf0222-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:03:37.320782 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:37.320764    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f42b0d30-openshift-default-5cb7dbc56d-q27zh"]
Jul 29 20:03:38.371018 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:38.370988    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" path="/var/lib/kubelet/pods/761d657f-92b1-49f6-b35a-d51875bf0222/volumes"
Jul 29 20:03:52.258808 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.258778    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"]
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259070    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259082    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259096    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e4842ce-646d-4d47-b9ae-10a1fd94134a" containerName="payload-processing"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259102    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e4842ce-646d-4d47-b9ae-10a1fd94134a" containerName="payload-processing"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259111    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259116    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259165    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259171    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="761d657f-92b1-49f6-b35a-d51875bf0222" containerName="istio-proxy"
Jul 29 20:03:52.259195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.259178    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e4842ce-646d-4d47-b9ae-10a1fd94134a" containerName="payload-processing"
Jul 29 20:03:52.265773 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.265746    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.268611 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.268574    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3a4cdcb0-openshift-default-dockercfg-hjbtt\""
Jul 29 20:03:52.276562 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.276537    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"]
Jul 29 20:03:52.330281 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330245    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-podinfo\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330423 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330298    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-credential-socket\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330423 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330355    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-certs\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330423 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330408    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-data\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330455    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-socket\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330474    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-envoy\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330492    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-token\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330651 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330558    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45fed1b-be2a-462a-bf21-dfced8413d02-istiod-ca-cert\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.330651 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.330592    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkx57\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-kube-api-access-jkx57\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.431521 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431487    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-podinfo\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.431697 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431526    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-credential-socket\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.431697 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431557    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-certs\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.431697 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431584    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-data\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.431697 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431626    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-socket\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.431697 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431648    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-envoy\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.431697 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431674    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-token\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.432000 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431800    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45fed1b-be2a-462a-bf21-dfced8413d02-istiod-ca-cert\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.432000 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431843    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkx57\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-kube-api-access-jkx57\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.432000 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431921    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-credential-socket\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.432000 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431982    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-certs\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.432000 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.431997    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-socket\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.432308 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.432286    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-data\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.432552 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.432536    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45fed1b-be2a-462a-bf21-dfced8413d02-istiod-ca-cert\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.433950 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.433927    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-envoy\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.434185 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.434167    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-podinfo\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.442101 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.442079    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-token\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.442328 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.442311    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkx57\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-kube-api-access-jkx57\") pod \"e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") " pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.577041 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.576963    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:52.713791 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.713766    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"]
Jul 29 20:03:52.715455 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:03:52.715426    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45fed1b_be2a_462a_bf21_dfced8413d02.slice/crio-4c8280cad969dd2d05b8d1b11e674c770608ca9e6edb8c26b51098e5d1c9a420 WatchSource:0}: Error finding container 4c8280cad969dd2d05b8d1b11e674c770608ca9e6edb8c26b51098e5d1c9a420: Status 404 returned error can't find the container with id 4c8280cad969dd2d05b8d1b11e674c770608ca9e6edb8c26b51098e5d1c9a420
Jul 29 20:03:52.717804 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.717771    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:03:52.717905 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.717832    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:03:52.717905 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:52.717860    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:03:53.369019 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:53.368986    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" event={"ID":"b45fed1b-be2a-462a-bf21-dfced8413d02","Type":"ContainerStarted","Data":"8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3"}
Jul 29 20:03:53.369481 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:53.369032    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" event={"ID":"b45fed1b-be2a-462a-bf21-dfced8413d02","Type":"ContainerStarted","Data":"4c8280cad969dd2d05b8d1b11e674c770608ca9e6edb8c26b51098e5d1c9a420"}
Jul 29 20:03:53.392206 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:53.392157    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" podStartSLOduration=1.392140225 podStartE2EDuration="1.392140225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:03:53.390271301 +0000 UTC m=+2041.544529921" watchObservedRunningTime="2026-07-29 20:03:53.392140225 +0000 UTC m=+2041.546398845"
Jul 29 20:03:53.577708 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:53.577670    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:53.582369 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:53.582344    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:54.373439 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:54.373408    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:03:54.374206 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:03:54.374186    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:04:10.213492 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.212814    2531 patch_prober.go:28] interesting pod/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:38180->10.133.0.43:15021: read: connection reset by peer" start-of-body=
Jul 29 20:04:10.213492 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.212887    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:38180->10.133.0.43:15021: read: connection reset by peer"
Jul 29 20:04:10.448666 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.448630    2531 generic.go:356] "Generic (PLEG): container finished" podID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerID="8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3" exitCode=0
Jul 29 20:04:10.448827 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.448708    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" event={"ID":"b45fed1b-be2a-462a-bf21-dfced8413d02","Type":"ContainerDied","Data":"8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3"}
Jul 29 20:04:10.449076 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.449047    2531 scope.go:117] "RemoveContainer" containerID="8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3"
Jul 29 20:04:10.450013 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.449985    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:04:10.450082 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.450049    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:04:10.450123 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:10.450106    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:04:11.457968 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:11.457926    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" event={"ID":"b45fed1b-be2a-462a-bf21-dfced8413d02","Type":"ContainerStarted","Data":"9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09"}
Jul 29 20:04:11.578808 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:11.578361    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:04:11.578808 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:11.578491    2531 patch_prober.go:28] interesting pod/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 20:04:11.578808 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:11.578537    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 20:04:12.577698 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:12.577659    2531 patch_prober.go:28] interesting pod/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 20:04:12.578329 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:12.578296    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 20:04:13.578089 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:13.577586    2531 patch_prober.go:28] interesting pod/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 20:04:13.578089 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:13.577647    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 20:04:14.577883 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:14.577845    2531 patch_prober.go:28] interesting pod/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 29 20:04:14.578220 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:14.578186    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 29 20:04:15.581945 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:15.581913    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:04:15.582357 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:15.582252    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:04:15.582850 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:15.582829    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:04:59.743677 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.743641    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"]
Jul 29 20:04:59.746651 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.746631    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"
Jul 29 20:04:59.749178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.749156    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:04:59.749178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.749156    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 20:04:59.763226 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.763196    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"]
Jul 29 20:04:59.813108 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.813042    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1649bc65-040b-4fb2-926d-1d0c9ae56a2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2\" (UID: \"1649bc65-040b-4fb2-926d-1d0c9ae56a2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"
Jul 29 20:04:59.914371 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.914324    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1649bc65-040b-4fb2-926d-1d0c9ae56a2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2\" (UID: \"1649bc65-040b-4fb2-926d-1d0c9ae56a2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"
Jul 29 20:04:59.914974 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:04:59.914954    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1649bc65-040b-4fb2-926d-1d0c9ae56a2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2\" (UID: \"1649bc65-040b-4fb2-926d-1d0c9ae56a2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"
Jul 29 20:05:00.059306 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:00.059223    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"
Jul 29 20:05:00.193584 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:00.193528    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"]
Jul 29 20:05:00.195687 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:05:00.195659    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1649bc65_040b_4fb2_926d_1d0c9ae56a2c.slice/crio-7012713737fc53bdb1c4c14989f404a5bc5004c16dc2e64899fafa4b2a67f9bb WatchSource:0}: Error finding container 7012713737fc53bdb1c4c14989f404a5bc5004c16dc2e64899fafa4b2a67f9bb: Status 404 returned error can't find the container with id 7012713737fc53bdb1c4c14989f404a5bc5004c16dc2e64899fafa4b2a67f9bb
Jul 29 20:05:00.694474 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:00.694433    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2" event={"ID":"1649bc65-040b-4fb2-926d-1d0c9ae56a2c","Type":"ContainerStarted","Data":"49a52b857a713b80048f9a4d51752747ff9456f8ff9d2e860926640e44c27b49"}
Jul 29 20:05:00.694640 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:00.694502    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2" event={"ID":"1649bc65-040b-4fb2-926d-1d0c9ae56a2c","Type":"ContainerStarted","Data":"7012713737fc53bdb1c4c14989f404a5bc5004c16dc2e64899fafa4b2a67f9bb"}
Jul 29 20:05:00.712654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:00.712600    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2" podStartSLOduration=1.712585409 podStartE2EDuration="1.712585409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:05:00.710564876 +0000 UTC m=+2108.864823496" watchObservedRunningTime="2026-07-29 20:05:00.712585409 +0000 UTC m=+2108.866844028"
Jul 29 20:05:01.700724 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:01.700687    2531 generic.go:356] "Generic (PLEG): container finished" podID="1649bc65-040b-4fb2-926d-1d0c9ae56a2c" containerID="49a52b857a713b80048f9a4d51752747ff9456f8ff9d2e860926640e44c27b49" exitCode=0
Jul 29 20:05:01.701157 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:01.700736    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2" event={"ID":"1649bc65-040b-4fb2-926d-1d0c9ae56a2c","Type":"ContainerDied","Data":"49a52b857a713b80048f9a4d51752747ff9456f8ff9d2e860926640e44c27b49"}
Jul 29 20:05:02.834902 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:02.834872    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"
Jul 29 20:05:02.942144 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:02.942105    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1649bc65-040b-4fb2-926d-1d0c9ae56a2c-maas-api-service-ca\") pod \"1649bc65-040b-4fb2-926d-1d0c9ae56a2c\" (UID: \"1649bc65-040b-4fb2-926d-1d0c9ae56a2c\") "
Jul 29 20:05:02.942457 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:02.942434    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1649bc65-040b-4fb2-926d-1d0c9ae56a2c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1649bc65-040b-4fb2-926d-1d0c9ae56a2c" (UID: "1649bc65-040b-4fb2-926d-1d0c9ae56a2c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:05:03.043479 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:03.043398    2531 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1649bc65-040b-4fb2-926d-1d0c9ae56a2c-maas-api-service-ca\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:05:03.711958 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:03.711924    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2" event={"ID":"1649bc65-040b-4fb2-926d-1d0c9ae56a2c","Type":"ContainerDied","Data":"7012713737fc53bdb1c4c14989f404a5bc5004c16dc2e64899fafa4b2a67f9bb"}
Jul 29 20:05:03.711958 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:03.711948    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"
Jul 29 20:05:03.712191 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:03.711973    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7012713737fc53bdb1c4c14989f404a5bc5004c16dc2e64899fafa4b2a67f9bb"
Jul 29 20:05:15.633137 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:15.633099    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"]
Jul 29 20:05:15.636430 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:15.636396    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3a4cdcb0-5fvp2"]
Jul 29 20:05:16.371671 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:16.371635    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1649bc65-040b-4fb2-926d-1d0c9ae56a2c" path="/var/lib/kubelet/pods/1649bc65-040b-4fb2-926d-1d0c9ae56a2c/volumes"
Jul 29 20:05:52.471955 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:52.471921    2531 scope.go:117] "RemoveContainer" containerID="cd533fe677742e78f3a780f0e2bbd2a4d00eb9545c1945201e1b30dc46c46932"
Jul 29 20:05:52.480249 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:05:52.480229    2531 scope.go:117] "RemoveContainer" containerID="4eb6c05d55bcdb5082c915a7b798e5b6ca520a9b9d5c354bf7cf8e6bb264216e"
Jul 29 20:06:30.617573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:30.617540    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"]
Jul 29 20:06:30.618099 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:30.617763    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy" containerID="cri-o://9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09" gracePeriod=30
Jul 29 20:06:35.871895 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.871867    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:06:35.916601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916530    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-envoy\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916580    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkx57\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-kube-api-access-jkx57\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916598    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-socket\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916625    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-podinfo\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916651    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-token\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916669    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-data\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916726    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-credential-socket\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916751    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-certs\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.916841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.916773    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45fed1b-be2a-462a-bf21-dfced8413d02-istiod-ca-cert\") pod \"b45fed1b-be2a-462a-bf21-dfced8413d02\" (UID: \"b45fed1b-be2a-462a-bf21-dfced8413d02\") "
Jul 29 20:06:35.917195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.917151    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:06:35.917260 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.917236    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b45fed1b-be2a-462a-bf21-dfced8413d02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:06:35.917583 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.917533    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:06:35.917679 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.917596    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:06:35.917679 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.917654    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-data" (OuterVolumeSpecName: "istio-data") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:06:35.918857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.918828    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:06:35.918992 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.918971    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-token" (OuterVolumeSpecName: "istio-token") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:06:35.919358 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.919336    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:06:35.919358 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:35.919340    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-kube-api-access-jkx57" (OuterVolumeSpecName: "kube-api-access-jkx57") pod "b45fed1b-be2a-462a-bf21-dfced8413d02" (UID: "b45fed1b-be2a-462a-bf21-dfced8413d02"). InnerVolumeSpecName "kube-api-access-jkx57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:06:36.018127 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018101    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkx57\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-kube-api-access-jkx57\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018127 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018122    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018127 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018131    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018140    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018148    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018155    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018163    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018171    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b45fed1b-be2a-462a-bf21-dfced8413d02-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.018349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.018178    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b45fed1b-be2a-462a-bf21-dfced8413d02-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:06:36.140350 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.140319    2531 generic.go:356] "Generic (PLEG): container finished" podID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerID="9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09" exitCode=0
Jul 29 20:06:36.140523 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.140361    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"
Jul 29 20:06:36.140523 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.140409    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" event={"ID":"b45fed1b-be2a-462a-bf21-dfced8413d02","Type":"ContainerDied","Data":"9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09"}
Jul 29 20:06:36.140523 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.140468    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t" event={"ID":"b45fed1b-be2a-462a-bf21-dfced8413d02","Type":"ContainerDied","Data":"4c8280cad969dd2d05b8d1b11e674c770608ca9e6edb8c26b51098e5d1c9a420"}
Jul 29 20:06:36.140523 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.140497    2531 scope.go:117] "RemoveContainer" containerID="9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09"
Jul 29 20:06:36.150205 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.150188    2531 scope.go:117] "RemoveContainer" containerID="8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3"
Jul 29 20:06:36.158186 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.158168    2531 scope.go:117] "RemoveContainer" containerID="9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09"
Jul 29 20:06:36.158431 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:06:36.158414    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09\": container with ID starting with 9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09 not found: ID does not exist" containerID="9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09"
Jul 29 20:06:36.158473 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.158441    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09"} err="failed to get container status \"9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09\": rpc error: code = NotFound desc = could not find container \"9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09\": container with ID starting with 9e6a2473c25b4c560b9a4593fc2a526510fc85082c48cbf7d86b61d917b64a09 not found: ID does not exist"
Jul 29 20:06:36.158473 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.158458    2531 scope.go:117] "RemoveContainer" containerID="8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3"
Jul 29 20:06:36.158672 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:06:36.158658    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3\": container with ID starting with 8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3 not found: ID does not exist" containerID="8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3"
Jul 29 20:06:36.158711 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.158677    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3"} err="failed to get container status \"8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3\": rpc error: code = NotFound desc = could not find container \"8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3\": container with ID starting with 8e16c14c46b2aabdcb706cece3dc2acce01587d62d822d111c2f83a09b50c0d3 not found: ID does not exist"
Jul 29 20:06:36.163440 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.163419    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"]
Jul 29 20:06:36.169440 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.169385    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3a4cdcb0-openshift-default-79b465688d-hh69t"]
Jul 29 20:06:36.372450 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:36.372420    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" path="/var/lib/kubelet/pods/b45fed1b-be2a-462a-bf21-dfced8413d02/volumes"
Jul 29 20:06:52.503622 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:06:52.503592    2531 scope.go:117] "RemoveContainer" containerID="a13a8c4d2229f56a4123001eac2654bb2f17871845d7bf84f2f07509fed3aba2"
Jul 29 20:07:26.981139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.979256    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"]
Jul 29 20:07:26.981139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.979884    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy"
Jul 29 20:07:26.981139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.979903    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy"
Jul 29 20:07:26.981139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.979962    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1649bc65-040b-4fb2-926d-1d0c9ae56a2c" containerName="revoke-keys"
Jul 29 20:07:26.981139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.979971    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="1649bc65-040b-4fb2-926d-1d0c9ae56a2c" containerName="revoke-keys"
Jul 29 20:07:26.981139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.980134    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy"
Jul 29 20:07:26.981139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.980152    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="1649bc65-040b-4fb2-926d-1d0c9ae56a2c" containerName="revoke-keys"
Jul 29 20:07:26.984385 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.984362    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:26.987741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.987710    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f5ad4c-openshift-default-dockercfg-tn65x\""
Jul 29 20:07:26.999902 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:26.999879    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"]
Jul 29 20:07:27.033534 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033503    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-envoy\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033538    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-credential-socket\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033556    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-istio-token\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033602    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42560acf-75a0-4d78-bcde-a91df74ef793-istiod-ca-cert\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033660    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-socket\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033704    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42560acf-75a0-4d78-bcde-a91df74ef793-istio-podinfo\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033729    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57wzw\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-kube-api-access-57wzw\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033767    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-data\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.033809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.033787    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-certs\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134480 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134447    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42560acf-75a0-4d78-bcde-a91df74ef793-istio-podinfo\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134480 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134482    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57wzw\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-kube-api-access-57wzw\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134682 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134603    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-data\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134682 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134636    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-certs\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134682 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134668    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-envoy\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134829 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134694    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-credential-socket\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134829 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134718    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-istio-token\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134829 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134739    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42560acf-75a0-4d78-bcde-a91df74ef793-istiod-ca-cert\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.134829 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.134798    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-socket\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.135170 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.135150    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-certs\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.135255 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.135171    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-data\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.135255 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.135207    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-credential-socket\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.135370 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.135278    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-socket\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.135561 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.135540    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42560acf-75a0-4d78-bcde-a91df74ef793-istiod-ca-cert\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.136960 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.136939    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-envoy\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.137261 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.137243    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42560acf-75a0-4d78-bcde-a91df74ef793-istio-podinfo\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.145844 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.145824    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57wzw\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-kube-api-access-57wzw\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.146079 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.146044    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-istio-token\") pod \"e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") " pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.294705 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.294624    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:27.436756 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.436725    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"]
Jul 29 20:07:27.438480 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:07:27.438455    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42560acf_75a0_4d78_bcde_a91df74ef793.slice/crio-5fb4e36f89d720630c9ce1c10749d3401804d2787262ca163aef6edbf2a4ec27 WatchSource:0}: Error finding container 5fb4e36f89d720630c9ce1c10749d3401804d2787262ca163aef6edbf2a4ec27: Status 404 returned error can't find the container with id 5fb4e36f89d720630c9ce1c10749d3401804d2787262ca163aef6edbf2a4ec27
Jul 29 20:07:27.440507 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.440476    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:27.440590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.440551    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:27.440590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:27.440582    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:28.390479 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:28.390446    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" event={"ID":"42560acf-75a0-4d78-bcde-a91df74ef793","Type":"ContainerStarted","Data":"3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21"}
Jul 29 20:07:28.390881 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:28.390493    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" event={"ID":"42560acf-75a0-4d78-bcde-a91df74ef793","Type":"ContainerStarted","Data":"5fb4e36f89d720630c9ce1c10749d3401804d2787262ca163aef6edbf2a4ec27"}
Jul 29 20:07:28.411706 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:28.411652    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" podStartSLOduration=2.4116328 podStartE2EDuration="2.4116328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:07:28.411328251 +0000 UTC m=+2256.565586870" watchObservedRunningTime="2026-07-29 20:07:28.4116328 +0000 UTC m=+2256.565891419"
Jul 29 20:07:29.295612 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:29.295572    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:29.300373 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:29.300348    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:29.394702 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:29.394676    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:29.395681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:29.395662    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:42.460182 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:42.460152    2531 generic.go:356] "Generic (PLEG): container finished" podID="42560acf-75a0-4d78-bcde-a91df74ef793" containerID="3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21" exitCode=0
Jul 29 20:07:42.460610 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:42.460232    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" event={"ID":"42560acf-75a0-4d78-bcde-a91df74ef793","Type":"ContainerDied","Data":"3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21"}
Jul 29 20:07:42.460610 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:42.460585    2531 scope.go:117] "RemoveContainer" containerID="3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21"
Jul 29 20:07:42.461550 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:42.461522    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:42.461643 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:42.461625    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:42.461693 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:42.461678    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:43.466847 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:43.466809    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" event={"ID":"42560acf-75a0-4d78-bcde-a91df74ef793","Type":"ContainerStarted","Data":"b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f"}
Jul 29 20:07:44.295157 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:44.295121    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:44.295642 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:44.295618    2531 patch_prober.go:28] interesting pod/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 29 20:07:44.295701 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:44.295669    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 29 20:07:44.395131 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:44.395092    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:45.295203 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:45.295161    2531 patch_prober.go:28] interesting pod/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 29 20:07:45.295594 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:45.295235    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 29 20:07:46.295376 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:46.295332    2531 patch_prober.go:28] interesting pod/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 29 20:07:46.295875 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:46.295405    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 29 20:07:47.299724 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:47.299693    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:47.300748 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:47.300728    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:07:55.944313 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:55.944275    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"]
Jul 29 20:07:55.944735 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:55.944716    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy"
Jul 29 20:07:55.944792 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:55.944740    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy"
Jul 29 20:07:55.944834 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:55.944825    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45fed1b-be2a-462a-bf21-dfced8413d02" containerName="istio-proxy"
Jul 29 20:07:55.946957 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:55.946939    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:55.950210 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:55.950185    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-620565-openshift-default-dockercfg-lz2dj\""
Jul 29 20:07:55.959824 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:55.959803    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"]
Jul 29 20:07:56.071249 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071217    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdcfx\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-kube-api-access-wdcfx\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071443 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071281    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-data\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071443 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071308    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-certs\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071443 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071353    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-token\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071443 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071398    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istiod-ca-cert\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071443 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071419    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-socket\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071443 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071436    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-podinfo\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071661 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071468    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-credential-socket\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.071661 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.071488    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-envoy\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172528 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172484    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istiod-ca-cert\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172528 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172525    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-socket\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172543    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-podinfo\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172581    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-credential-socket\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172606    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-envoy\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172642    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdcfx\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-kube-api-access-wdcfx\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172701    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-data\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172728    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-certs\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.172781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.172770    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-token\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.173194 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.173001    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-socket\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.173194 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.173038    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-credential-socket\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.173301 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.173200    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-data\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.173359 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.173304    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-certs\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.173615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.173372    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istiod-ca-cert\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.175039 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.175015    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-envoy\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.175400 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.175380    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-podinfo\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.181875 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.181850    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-token\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.182471 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.182453    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdcfx\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-kube-api-access-wdcfx\") pod \"e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") " pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.258675 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.258588    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:56.399078 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.399036    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"]
Jul 29 20:07:56.400358 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:07:56.400326    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode258c84e_8bd7_4aa3_b502_29b3ecb7fc89.slice/crio-6e9fa853c734b2de1955b1915ca9f9c39800bcc17cb12fd64c421f048113c4de WatchSource:0}: Error finding container 6e9fa853c734b2de1955b1915ca9f9c39800bcc17cb12fd64c421f048113c4de: Status 404 returned error can't find the container with id 6e9fa853c734b2de1955b1915ca9f9c39800bcc17cb12fd64c421f048113c4de
Jul 29 20:07:56.404953 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.404918    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:56.405043 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.404987    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:56.405043 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.405015    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:07:56.535595 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.535494    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" event={"ID":"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89","Type":"ContainerStarted","Data":"357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209"}
Jul 29 20:07:56.535595 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.535564    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" event={"ID":"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89","Type":"ContainerStarted","Data":"6e9fa853c734b2de1955b1915ca9f9c39800bcc17cb12fd64c421f048113c4de"}
Jul 29 20:07:56.557073 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:56.556999    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" podStartSLOduration=1.556984954 podStartE2EDuration="1.556984954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:07:56.55602315 +0000 UTC m=+2284.710281769" watchObservedRunningTime="2026-07-29 20:07:56.556984954 +0000 UTC m=+2284.711243573"
Jul 29 20:07:57.259309 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:57.259267    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:57.264079 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:57.264038    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:57.540946 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:57.540866    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:57.541719 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:57.541703    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:07:59.381383 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.381338    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"]
Jul 29 20:07:59.384132 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.384117    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:07:59.386581 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.386559    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-620565\""
Jul 29 20:07:59.386694 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.386613    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-620565-dockercfg-4hg8s\""
Jul 29 20:07:59.395331 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.395311    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"]
Jul 29 20:07:59.501152 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.501086    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:07:59.501334 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.501249    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mw8d\" (UniqueName: \"kubernetes.io/projected/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-kube-api-access-6mw8d\") pod \"payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:07:59.602513 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.602470    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:07:59.602712 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.602572    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mw8d\" (UniqueName: \"kubernetes.io/projected/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-kube-api-access-6mw8d\") pod \"payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:07:59.603219 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.603194    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:07:59.611884 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.611859    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mw8d\" (UniqueName: \"kubernetes.io/projected/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-kube-api-access-6mw8d\") pod \"payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:07:59.695432 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:07:59.695405    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:08:00.034428 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:00.034393    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"]
Jul 29 20:08:00.035693 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:08:00.035655    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2858f0a6_3e1e_4668_af30_a1e2a1522a6b.slice/crio-8f634660998f06c8488ef2bb66c6ff4b90e517ac039604f8c5234369b4bffb0c WatchSource:0}: Error finding container 8f634660998f06c8488ef2bb66c6ff4b90e517ac039604f8c5234369b4bffb0c: Status 404 returned error can't find the container with id 8f634660998f06c8488ef2bb66c6ff4b90e517ac039604f8c5234369b4bffb0c
Jul 29 20:08:00.557592 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:00.557559    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j" event={"ID":"2858f0a6-3e1e-4668-af30-a1e2a1522a6b","Type":"ContainerStarted","Data":"ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e"}
Jul 29 20:08:00.558029 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:00.557651    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:08:00.558029 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:00.557676    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j" event={"ID":"2858f0a6-3e1e-4668-af30-a1e2a1522a6b","Type":"ContainerStarted","Data":"8f634660998f06c8488ef2bb66c6ff4b90e517ac039604f8c5234369b4bffb0c"}
Jul 29 20:08:00.574403 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:00.574355    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j" podStartSLOduration=1.5743405510000001 podStartE2EDuration="1.574340551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:08:00.573110874 +0000 UTC m=+2288.727369495" watchObservedRunningTime="2026-07-29 20:08:00.574340551 +0000 UTC m=+2288.728599168"
Jul 29 20:08:11.565712 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:11.565673    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:08:13.545906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.544511    2531 patch_prober.go:28] interesting pod/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 20:08:13.545906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.544573    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 20:08:13.627185 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.627150    2531 generic.go:356] "Generic (PLEG): container finished" podID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerID="357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209" exitCode=0
Jul 29 20:08:13.627377 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.627229    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" event={"ID":"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89","Type":"ContainerDied","Data":"357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209"}
Jul 29 20:08:13.627702 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.627685    2531 scope.go:117] "RemoveContainer" containerID="357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209"
Jul 29 20:08:13.628754 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.628725    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:08:13.628864 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.628792    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:08:13.628864 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:13.628822    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:08:14.634005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:14.633971    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" event={"ID":"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89","Type":"ContainerStarted","Data":"a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45"}
Jul 29 20:08:15.259114 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:15.259075    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:08:15.259390 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:15.259367    2531 patch_prober.go:28] interesting pod/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 20:08:15.259437 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:15.259420    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 20:08:16.259632 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:16.259595    2531 patch_prober.go:28] interesting pod/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 20:08:16.260025 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:16.259655    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 20:08:17.258972 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:17.258936    2531 patch_prober.go:28] interesting pod/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 20:08:17.259178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:17.258996    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 20:08:18.259108 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:18.259046    2531 patch_prober.go:28] interesting pod/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 29 20:08:18.259513 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:18.259138    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 29 20:08:19.263025 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:19.262994    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:08:19.263449 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:19.263286    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:08:19.263844 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:19.263827    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:08:37.275074 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.275025    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"]
Jul 29 20:08:37.278267 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.278249    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.281999 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.281976    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f5ad4c\"/\"openshift-service-ca.crt\""
Jul 29 20:08:37.282146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.282032    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f5ad4c\"/\"test-model-f5ad4c-kserve-self-signed-certs\""
Jul 29 20:08:37.282146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.282074    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f5ad4c\"/\"default-dockercfg-pxwvc\""
Jul 29 20:08:37.282146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.282032    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f5ad4c\"/\"kube-root-ca.crt\""
Jul 29 20:08:37.288610 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.288589    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"]
Jul 29 20:08:37.316776 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.316744    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tls-certs\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.316932 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.316797    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-home\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.316932 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.316868    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-model-cache\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.317020 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.316937    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dst\" (UniqueName: \"kubernetes.io/projected/b9473b8c-9958-4e02-b8f6-ed66b21402fe-kube-api-access-v5dst\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.317020 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.316958    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tmp-dir\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.317020 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.316982    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-dshm\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.417594 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.417555    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tls-certs\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.417786 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.417608    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-home\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.417786 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.417737    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-model-cache\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.417911 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.417851    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dst\" (UniqueName: \"kubernetes.io/projected/b9473b8c-9958-4e02-b8f6-ed66b21402fe-kube-api-access-v5dst\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.417911 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.417884    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tmp-dir\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.418013 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.417926    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-dshm\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.418013 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.417975    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-home\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.418125 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.418042    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-model-cache\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.418249 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.418230    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tmp-dir\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.420272 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.420252    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-dshm\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.420272 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.420261    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tls-certs\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.427793 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.427763    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dst\" (UniqueName: \"kubernetes.io/projected/b9473b8c-9958-4e02-b8f6-ed66b21402fe-kube-api-access-v5dst\") pod \"test-model-f5ad4c-kserve-8b4677c87-fz662\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") " pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.587304 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.587210    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:37.717084 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.717036    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"]
Jul 29 20:08:37.718440 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:08:37.718415    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9473b8c_9958_4e02_b8f6_ed66b21402fe.slice/crio-f7967ee63358739a9fe6b0c12abc3aa4fba4062e829e06d26585e9b7ae6baa35 WatchSource:0}: Error finding container f7967ee63358739a9fe6b0c12abc3aa4fba4062e829e06d26585e9b7ae6baa35: Status 404 returned error can't find the container with id f7967ee63358739a9fe6b0c12abc3aa4fba4062e829e06d26585e9b7ae6baa35
Jul 29 20:08:37.743215 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:37.743188    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662" event={"ID":"b9473b8c-9958-4e02-b8f6-ed66b21402fe","Type":"ContainerStarted","Data":"f7967ee63358739a9fe6b0c12abc3aa4fba4062e829e06d26585e9b7ae6baa35"}
Jul 29 20:08:38.749568 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:38.749533    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662" event={"ID":"b9473b8c-9958-4e02-b8f6-ed66b21402fe","Type":"ContainerStarted","Data":"3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10"}
Jul 29 20:08:38.768684 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:38.768636    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662" podStartSLOduration=1.768622035 podStartE2EDuration="1.768622035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:08:38.767436448 +0000 UTC m=+2326.921695068" watchObservedRunningTime="2026-07-29 20:08:38.768622035 +0000 UTC m=+2326.922880692"
Jul 29 20:08:47.587862 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:47.587771    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:47.587862 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:47.587829    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:47.600543 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:47.600521    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:08:47.801354 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:08:47.801328    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:09:58.334324 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:09:58.334290    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"]
Jul 29 20:10:13.353147 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.353026    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662" podUID="b9473b8c-9958-4e02-b8f6-ed66b21402fe" containerName="main" containerID="cri-o://3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10" gracePeriod=45
Jul 29 20:10:13.606939 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.606883    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:10:13.755031 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.754994    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-model-cache\") pod \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") "
Jul 29 20:10:13.755265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755092    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5dst\" (UniqueName: \"kubernetes.io/projected/b9473b8c-9958-4e02-b8f6-ed66b21402fe-kube-api-access-v5dst\") pod \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") "
Jul 29 20:10:13.755265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755116    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tls-certs\") pod \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") "
Jul 29 20:10:13.755265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755167    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tmp-dir\") pod \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") "
Jul 29 20:10:13.755265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755199    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-dshm\") pod \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") "
Jul 29 20:10:13.755265 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755251    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-home\") pod \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\" (UID: \"b9473b8c-9958-4e02-b8f6-ed66b21402fe\") "
Jul 29 20:10:13.755525 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755380    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9473b8c-9958-4e02-b8f6-ed66b21402fe" (UID: "b9473b8c-9958-4e02-b8f6-ed66b21402fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:13.755525 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755434    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9473b8c-9958-4e02-b8f6-ed66b21402fe" (UID: "b9473b8c-9958-4e02-b8f6-ed66b21402fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:13.755525 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755496    2531 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-model-cache\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:13.755635 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.755576    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-home" (OuterVolumeSpecName: "home") pod "b9473b8c-9958-4e02-b8f6-ed66b21402fe" (UID: "b9473b8c-9958-4e02-b8f6-ed66b21402fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:13.757502 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.757467    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-dshm" (OuterVolumeSpecName: "dshm") pod "b9473b8c-9958-4e02-b8f6-ed66b21402fe" (UID: "b9473b8c-9958-4e02-b8f6-ed66b21402fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:13.757627 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.757553    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9473b8c-9958-4e02-b8f6-ed66b21402fe" (UID: "b9473b8c-9958-4e02-b8f6-ed66b21402fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:10:13.757627 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.757578    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9473b8c-9958-4e02-b8f6-ed66b21402fe-kube-api-access-v5dst" (OuterVolumeSpecName: "kube-api-access-v5dst") pod "b9473b8c-9958-4e02-b8f6-ed66b21402fe" (UID: "b9473b8c-9958-4e02-b8f6-ed66b21402fe"). InnerVolumeSpecName "kube-api-access-v5dst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:10:13.856866 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.856827    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5dst\" (UniqueName: \"kubernetes.io/projected/b9473b8c-9958-4e02-b8f6-ed66b21402fe-kube-api-access-v5dst\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:13.856866 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.856860    2531 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tls-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:13.856866 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.856876    2531 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-tmp-dir\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:13.857154 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.856883    2531 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-dshm\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:13.857154 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:13.856892    2531 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9473b8c-9958-4e02-b8f6-ed66b21402fe-home\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:14.204612 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.204579    2531 generic.go:356] "Generic (PLEG): container finished" podID="b9473b8c-9958-4e02-b8f6-ed66b21402fe" containerID="3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10" exitCode=0
Jul 29 20:10:14.204773 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.204627    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"
Jul 29 20:10:14.204773 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.204666    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662" event={"ID":"b9473b8c-9958-4e02-b8f6-ed66b21402fe","Type":"ContainerDied","Data":"3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10"}
Jul 29 20:10:14.204773 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.204710    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662" event={"ID":"b9473b8c-9958-4e02-b8f6-ed66b21402fe","Type":"ContainerDied","Data":"f7967ee63358739a9fe6b0c12abc3aa4fba4062e829e06d26585e9b7ae6baa35"}
Jul 29 20:10:14.204773 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.204727    2531 scope.go:117] "RemoveContainer" containerID="3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10"
Jul 29 20:10:14.213736 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.213717    2531 scope.go:117] "RemoveContainer" containerID="3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10"
Jul 29 20:10:14.213997 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:10:14.213977    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10\": container with ID starting with 3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10 not found: ID does not exist" containerID="3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10"
Jul 29 20:10:14.214044 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.214005    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10"} err="failed to get container status \"3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10\": rpc error: code = NotFound desc = could not find container \"3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10\": container with ID starting with 3e0ad2bb0a9cdc58720726f7a0e976f9bb817d787f03d8efcfc4ff81abdf3b10 not found: ID does not exist"
Jul 29 20:10:14.228250 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.228229    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"]
Jul 29 20:10:14.234062 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.234034    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-f5ad4c/test-model-f5ad4c-kserve-8b4677c87-fz662"]
Jul 29 20:10:14.374697 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:14.374670    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9473b8c-9958-4e02-b8f6-ed66b21402fe" path="/var/lib/kubelet/pods/b9473b8c-9958-4e02-b8f6-ed66b21402fe/volumes"
Jul 29 20:10:17.243129 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:17.243097    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"]
Jul 29 20:10:17.243572 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:17.243332    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy" containerID="cri-o://b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f" gracePeriod=30
Jul 29 20:10:17.302320 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:17.302286    2531 patch_prober.go:28] interesting pod/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 20:10:17.302473 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:17.302364    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 20:10:22.498753 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.498729    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:10:22.527329 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527258    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-credential-socket\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527329 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527289    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-data\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527329 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527328    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-istio-token\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527350    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42560acf-75a0-4d78-bcde-a91df74ef793-istio-podinfo\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527382    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42560acf-75a0-4d78-bcde-a91df74ef793-istiod-ca-cert\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527400    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-socket\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527431    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57wzw\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-kube-api-access-57wzw\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527469    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-certs\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527508    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-envoy\") pod \"42560acf-75a0-4d78-bcde-a91df74ef793\" (UID: \"42560acf-75a0-4d78-bcde-a91df74ef793\") "
Jul 29 20:10:22.527573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527510    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:22.527863 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527695    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.527863 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.527829    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:22.528043 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.528003    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42560acf-75a0-4d78-bcde-a91df74ef793-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:10:22.528043 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.528064    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:22.529118 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.529024    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-data" (OuterVolumeSpecName: "istio-data") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:22.529822 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.529788    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-istio-token" (OuterVolumeSpecName: "istio-token") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:10:22.529919 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.529891    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42560acf-75a0-4d78-bcde-a91df74ef793-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:10:22.530328 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.530308    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-kube-api-access-57wzw" (OuterVolumeSpecName: "kube-api-access-57wzw") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "kube-api-access-57wzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:10:22.530431 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.530416    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42560acf-75a0-4d78-bcde-a91df74ef793" (UID: "42560acf-75a0-4d78-bcde-a91df74ef793"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:22.628856 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628825    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.628856 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628851    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.629032 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628863    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.629032 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628875    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42560acf-75a0-4d78-bcde-a91df74ef793-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.629032 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628888    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42560acf-75a0-4d78-bcde-a91df74ef793-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.629032 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628898    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.629032 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628909    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57wzw\" (UniqueName: \"kubernetes.io/projected/42560acf-75a0-4d78-bcde-a91df74ef793-kube-api-access-57wzw\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:22.629032 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:22.628921    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42560acf-75a0-4d78-bcde-a91df74ef793-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:23.257458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.257418    2531 generic.go:356] "Generic (PLEG): container finished" podID="42560acf-75a0-4d78-bcde-a91df74ef793" containerID="b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f" exitCode=0
Jul 29 20:10:23.257659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.257488    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"
Jul 29 20:10:23.257659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.257492    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" event={"ID":"42560acf-75a0-4d78-bcde-a91df74ef793","Type":"ContainerDied","Data":"b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f"}
Jul 29 20:10:23.257659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.257575    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4" event={"ID":"42560acf-75a0-4d78-bcde-a91df74ef793","Type":"ContainerDied","Data":"5fb4e36f89d720630c9ce1c10749d3401804d2787262ca163aef6edbf2a4ec27"}
Jul 29 20:10:23.257659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.257605    2531 scope.go:117] "RemoveContainer" containerID="b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f"
Jul 29 20:10:23.267390 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.267373    2531 scope.go:117] "RemoveContainer" containerID="3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21"
Jul 29 20:10:23.275252 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.275236    2531 scope.go:117] "RemoveContainer" containerID="b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f"
Jul 29 20:10:23.275489 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:10:23.275473    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f\": container with ID starting with b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f not found: ID does not exist" containerID="b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f"
Jul 29 20:10:23.275529 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.275496    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f"} err="failed to get container status \"b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f\": rpc error: code = NotFound desc = could not find container \"b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f\": container with ID starting with b1222147d0893b3886eb1a0250214594b2e06dc5e6c684c4ef363dfa237f5f3f not found: ID does not exist"
Jul 29 20:10:23.275529 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.275512    2531 scope.go:117] "RemoveContainer" containerID="3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21"
Jul 29 20:10:23.275748 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:10:23.275730    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21\": container with ID starting with 3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21 not found: ID does not exist" containerID="3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21"
Jul 29 20:10:23.275796 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.275755    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21"} err="failed to get container status \"3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21\": rpc error: code = NotFound desc = could not find container \"3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21\": container with ID starting with 3ea707255efa4986656af62795108e37aacfe0321c86d084444b02e76728af21 not found: ID does not exist"
Jul 29 20:10:23.281030 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.281010    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"]
Jul 29 20:10:23.285696 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:23.285676    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f5ad4c-openshift-default-59b5dbbc76-5dph4"]
Jul 29 20:10:24.371187 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:24.371156    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" path="/var/lib/kubelet/pods/42560acf-75a0-4d78-bcde-a91df74ef793/volumes"
Jul 29 20:10:28.258094 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.258044    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"]
Jul 29 20:10:28.258566 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.258281    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j" podUID="2858f0a6-3e1e-4668-af30-a1e2a1522a6b" containerName="payload-pre-processing" containerID="cri-o://ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e" gracePeriod=30
Jul 29 20:10:28.510985 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.510933    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:10:28.573721 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.573690    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mw8d\" (UniqueName: \"kubernetes.io/projected/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-kube-api-access-6mw8d\") pod \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") "
Jul 29 20:10:28.573721 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.573728    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-plugins-config-volume\") pod \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\" (UID: \"2858f0a6-3e1e-4668-af30-a1e2a1522a6b\") "
Jul 29 20:10:28.574249 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.574219    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2858f0a6-3e1e-4668-af30-a1e2a1522a6b" (UID: "2858f0a6-3e1e-4668-af30-a1e2a1522a6b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:10:28.576167 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.576136    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-kube-api-access-6mw8d" (OuterVolumeSpecName: "kube-api-access-6mw8d") pod "2858f0a6-3e1e-4668-af30-a1e2a1522a6b" (UID: "2858f0a6-3e1e-4668-af30-a1e2a1522a6b"). InnerVolumeSpecName "kube-api-access-6mw8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:10:28.674924 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.674885    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mw8d\" (UniqueName: \"kubernetes.io/projected/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-kube-api-access-6mw8d\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:28.674924 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:28.674922    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2858f0a6-3e1e-4668-af30-a1e2a1522a6b-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:29.293741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.293704    2531 generic.go:356] "Generic (PLEG): container finished" podID="2858f0a6-3e1e-4668-af30-a1e2a1522a6b" containerID="ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e" exitCode=0
Jul 29 20:10:29.294172 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.293762    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"
Jul 29 20:10:29.294172 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.293795    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j" event={"ID":"2858f0a6-3e1e-4668-af30-a1e2a1522a6b","Type":"ContainerDied","Data":"ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e"}
Jul 29 20:10:29.294172 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.293878    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j" event={"ID":"2858f0a6-3e1e-4668-af30-a1e2a1522a6b","Type":"ContainerDied","Data":"8f634660998f06c8488ef2bb66c6ff4b90e517ac039604f8c5234369b4bffb0c"}
Jul 29 20:10:29.294172 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.293905    2531 scope.go:117] "RemoveContainer" containerID="ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e"
Jul 29 20:10:29.302497 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.302482    2531 scope.go:117] "RemoveContainer" containerID="ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e"
Jul 29 20:10:29.302735 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:10:29.302717    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e\": container with ID starting with ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e not found: ID does not exist" containerID="ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e"
Jul 29 20:10:29.302804 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.302743    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e"} err="failed to get container status \"ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e\": rpc error: code = NotFound desc = could not find container \"ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e\": container with ID starting with ac456c6f647ea80ad490d6cc4782e06387f6aa67b0196a99f2b97ef20072978e not found: ID does not exist"
Jul 29 20:10:29.319320 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.319299    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"]
Jul 29 20:10:29.322621 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:29.322599    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-620565-586d97c4bd-v4b6j"]
Jul 29 20:10:30.372698 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:30.372663    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2858f0a6-3e1e-4668-af30-a1e2a1522a6b" path="/var/lib/kubelet/pods/2858f0a6-3e1e-4668-af30-a1e2a1522a6b/volumes"
Jul 29 20:10:35.466246 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:35.466201    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"]
Jul 29 20:10:35.466731 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:35.466441    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy" containerID="cri-o://a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45" gracePeriod=30
Jul 29 20:10:36.329979 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.329946    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"]
Jul 29 20:10:36.330387 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330372    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9473b8c-9958-4e02-b8f6-ed66b21402fe" containerName="main"
Jul 29 20:10:36.330436 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330392    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9473b8c-9958-4e02-b8f6-ed66b21402fe" containerName="main"
Jul 29 20:10:36.330436 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330412    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy"
Jul 29 20:10:36.330436 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330421    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy"
Jul 29 20:10:36.330531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330434    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy"
Jul 29 20:10:36.330531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330443    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy"
Jul 29 20:10:36.330531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330460    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2858f0a6-3e1e-4668-af30-a1e2a1522a6b" containerName="payload-pre-processing"
Jul 29 20:10:36.330531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330468    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="2858f0a6-3e1e-4668-af30-a1e2a1522a6b" containerName="payload-pre-processing"
Jul 29 20:10:36.330649 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330539    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy"
Jul 29 20:10:36.330649 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330548    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="2858f0a6-3e1e-4668-af30-a1e2a1522a6b" containerName="payload-pre-processing"
Jul 29 20:10:36.330649 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330558    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9473b8c-9958-4e02-b8f6-ed66b21402fe" containerName="main"
Jul 29 20:10:36.330649 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.330567    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="42560acf-75a0-4d78-bcde-a91df74ef793" containerName="istio-proxy"
Jul 29 20:10:36.334935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.334918    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.337355 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.337334    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-78b35e-openshift-default-dockercfg-4b5sp\""
Jul 29 20:10:36.346146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.346124    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"]
Jul 29 20:10:36.444145 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444086    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbbf9\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-kube-api-access-dbbf9\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444348 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444161    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-envoy\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444348 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444235    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdf8790b-c632-4904-bf82-feff572ad3fc-istiod-ca-cert\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444348 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444269    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-credential-socket\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444348 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444295    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-token\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444348 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444328    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-data\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444359    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-certs\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444411    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-socket\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.444615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.444457    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-podinfo\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545354 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545305    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdf8790b-c632-4904-bf82-feff572ad3fc-istiod-ca-cert\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545354 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545360    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-credential-socket\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545386    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-token\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545415    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-data\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545447    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-certs\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545600    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-socket\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545672    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-podinfo\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545707    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbbf9\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-kube-api-access-dbbf9\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545737    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-envoy\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.545878 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545835    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-certs\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.546273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545880    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-data\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.546273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545956    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-socket\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.546273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.545969    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-credential-socket\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.546273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.546094    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdf8790b-c632-4904-bf82-feff572ad3fc-istiod-ca-cert\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.548179 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.548153    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-envoy\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.548283 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.548184    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-podinfo\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.554293 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.554274    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbbf9\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-kube-api-access-dbbf9\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.554434 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.554405    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-token\") pod \"e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") " pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.646524 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.646432    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:36.784210 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.784175    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"]
Jul 29 20:10:36.787130 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:10:36.787103    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf8790b_c632_4904_bf82_feff572ad3fc.slice/crio-258f4812722260cad873a96471dfe9b3173763e07c30e688a9b2369e70473d2e WatchSource:0}: Error finding container 258f4812722260cad873a96471dfe9b3173763e07c30e688a9b2369e70473d2e: Status 404 returned error can't find the container with id 258f4812722260cad873a96471dfe9b3173763e07c30e688a9b2369e70473d2e
Jul 29 20:10:36.789447 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.789414    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:10:36.789534 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.789480    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:10:36.789534 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:36.789508    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:10:37.338385 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:37.338347    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" event={"ID":"cdf8790b-c632-4904-bf82-feff572ad3fc","Type":"ContainerStarted","Data":"29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee"}
Jul 29 20:10:37.338571 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:37.338404    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" event={"ID":"cdf8790b-c632-4904-bf82-feff572ad3fc","Type":"ContainerStarted","Data":"258f4812722260cad873a96471dfe9b3173763e07c30e688a9b2369e70473d2e"}
Jul 29 20:10:37.360479 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:37.360428    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podStartSLOduration=1.360413831 podStartE2EDuration="1.360413831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:10:37.358387166 +0000 UTC m=+2445.512645784" watchObservedRunningTime="2026-07-29 20:10:37.360413831 +0000 UTC m=+2445.514672447"
Jul 29 20:10:37.647472 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:37.647381    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:37.652244 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:37.652219    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:38.343831 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:38.343799    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:38.344906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:38.344887    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:40.311223 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.311188    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"]
Jul 29 20:10:40.314664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.314648    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.317378 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.317359    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-78b35e-dockercfg-mj4sn\""
Jul 29 20:10:40.317477 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.317446    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-78b35e\""
Jul 29 20:10:40.325010 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.324985    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"]
Jul 29 20:10:40.382824 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.382786    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlb9d\" (UniqueName: \"kubernetes.io/projected/50e04ac2-d645-44f0-a7af-9a554ed5e15c-kube-api-access-rlb9d\") pod \"payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.382991 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.382855    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50e04ac2-d645-44f0-a7af-9a554ed5e15c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.483628 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.483595    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50e04ac2-d645-44f0-a7af-9a554ed5e15c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.483847 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.483754    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlb9d\" (UniqueName: \"kubernetes.io/projected/50e04ac2-d645-44f0-a7af-9a554ed5e15c-kube-api-access-rlb9d\") pod \"payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.484584 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.484559    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50e04ac2-d645-44f0-a7af-9a554ed5e15c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.492177 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.492156    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlb9d\" (UniqueName: \"kubernetes.io/projected/50e04ac2-d645-44f0-a7af-9a554ed5e15c-kube-api-access-rlb9d\") pod \"payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.625795 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.625763    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:40.719147 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.719118    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:10:40.775495 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.775471    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"]
Jul 29 20:10:40.776973 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:10:40.776951    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e04ac2_d645_44f0_a7af_9a554ed5e15c.slice/crio-715ae7224c79e2b44b51fda170cd556a982ae77c690dd49ff540374ea692f6f4 WatchSource:0}: Error finding container 715ae7224c79e2b44b51fda170cd556a982ae77c690dd49ff540374ea692f6f4: Status 404 returned error can't find the container with id 715ae7224c79e2b44b51fda170cd556a982ae77c690dd49ff540374ea692f6f4
Jul 29 20:10:40.786924 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.786906    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-envoy\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.786995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.786937    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-socket\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.786995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.786972    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istiod-ca-cert\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.787097 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787002    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdcfx\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-kube-api-access-wdcfx\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.787097 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787048    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-certs\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.787198 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787095    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-data\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.787198 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787139    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-token\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.787198 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787168    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-credential-socket\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.787352 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787243    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:40.787352 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787262    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-podinfo\") pod \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\" (UID: \"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89\") "
Jul 29 20:10:40.787514 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787490    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:10:40.787514 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787501    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:40.787639 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787551    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.787917 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.787864    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:40.788202 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.788182    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-data" (OuterVolumeSpecName: "istio-data") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:40.789426 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.789400    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-kube-api-access-wdcfx" (OuterVolumeSpecName: "kube-api-access-wdcfx") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "kube-api-access-wdcfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:10:40.789740 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.789721    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:10:40.789882 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.789866    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-token" (OuterVolumeSpecName: "istio-token") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:10:40.789997 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.789984    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" (UID: "e258c84e-8bd7-4aa3-b502-29b3ecb7fc89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888524    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888550    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888560    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888568    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdcfx\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-kube-api-access-wdcfx\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888577    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888584    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888591    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:40.888604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:40.888599    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:10:41.369144 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.369110    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2" event={"ID":"50e04ac2-d645-44f0-a7af-9a554ed5e15c","Type":"ContainerStarted","Data":"0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686"}
Jul 29 20:10:41.369618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.369156    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2" event={"ID":"50e04ac2-d645-44f0-a7af-9a554ed5e15c","Type":"ContainerStarted","Data":"715ae7224c79e2b44b51fda170cd556a982ae77c690dd49ff540374ea692f6f4"}
Jul 29 20:10:41.369618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.369194    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:41.370687 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.370663    2531 generic.go:356] "Generic (PLEG): container finished" podID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerID="a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45" exitCode=0
Jul 29 20:10:41.370816 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.370716    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"
Jul 29 20:10:41.370816 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.370750    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" event={"ID":"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89","Type":"ContainerDied","Data":"a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45"}
Jul 29 20:10:41.370816 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.370796    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp" event={"ID":"e258c84e-8bd7-4aa3-b502-29b3ecb7fc89","Type":"ContainerDied","Data":"6e9fa853c734b2de1955b1915ca9f9c39800bcc17cb12fd64c421f048113c4de"}
Jul 29 20:10:41.370924 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.370818    2531 scope.go:117] "RemoveContainer" containerID="a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45"
Jul 29 20:10:41.379415 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.379384    2531 scope.go:117] "RemoveContainer" containerID="357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209"
Jul 29 20:10:41.387164 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.387123    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2" podStartSLOduration=1.387109899 podStartE2EDuration="1.387109899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:10:41.385536332 +0000 UTC m=+2449.539794952" watchObservedRunningTime="2026-07-29 20:10:41.387109899 +0000 UTC m=+2449.541368517"
Jul 29 20:10:41.387953 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.387939    2531 scope.go:117] "RemoveContainer" containerID="a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45"
Jul 29 20:10:41.388208 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:10:41.388186    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45\": container with ID starting with a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45 not found: ID does not exist" containerID="a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45"
Jul 29 20:10:41.388287 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.388215    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45"} err="failed to get container status \"a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45\": rpc error: code = NotFound desc = could not find container \"a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45\": container with ID starting with a636619a517720b264c375d5e13ad324660dc9fb1624cfb310102e9deed40d45 not found: ID does not exist"
Jul 29 20:10:41.388287 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.388232    2531 scope.go:117] "RemoveContainer" containerID="357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209"
Jul 29 20:10:41.388469 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:10:41.388451    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209\": container with ID starting with 357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209 not found: ID does not exist" containerID="357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209"
Jul 29 20:10:41.388525 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.388473    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209"} err="failed to get container status \"357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209\": rpc error: code = NotFound desc = could not find container \"357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209\": container with ID starting with 357a5156558594ee248a0e1d7a039c4121c2f9a499d27715e689400633653209 not found: ID does not exist"
Jul 29 20:10:41.400639 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.400607    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"]
Jul 29 20:10:41.405159 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:41.405139    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-620565-openshift-default-5f96549bb4-ntjcp"]
Jul 29 20:10:42.371446 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:42.371414    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" path="/var/lib/kubelet/pods/e258c84e-8bd7-4aa3-b502-29b3ecb7fc89/volumes"
Jul 29 20:10:52.378740 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:52.378711    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:10:53.488577 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:53.487784    2531 patch_prober.go:28] interesting pod/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:58996->10.133.0.49:15021: read: connection reset by peer" start-of-body=
Jul 29 20:10:53.488577 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:53.487848    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:58996->10.133.0.49:15021: read: connection reset by peer"
Jul 29 20:10:54.435035 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:54.434993    2531 generic.go:356] "Generic (PLEG): container finished" podID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerID="29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee" exitCode=0
Jul 29 20:10:54.435246 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:54.435079    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" event={"ID":"cdf8790b-c632-4904-bf82-feff572ad3fc","Type":"ContainerDied","Data":"29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee"}
Jul 29 20:10:54.435474 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:54.435459    2531 scope.go:117] "RemoveContainer" containerID="29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee"
Jul 29 20:10:54.436422 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:54.436392    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:10:54.436479 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:54.436467    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:10:54.436514 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:54.436504    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:10:55.441429 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:55.441398    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" event={"ID":"cdf8790b-c632-4904-bf82-feff572ad3fc","Type":"ContainerStarted","Data":"a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc"}
Jul 29 20:10:55.646599 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:55.646569    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:10:55.646811 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:55.646791    2531 patch_prober.go:28] interesting pod/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 20:10:55.646858 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:55.646838    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 20:10:56.647326 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:56.647290    2531 patch_prober.go:28] interesting pod/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 20:10:56.647734 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:56.647346    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 20:10:57.647188 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:57.647146    2531 patch_prober.go:28] interesting pod/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 20:10:57.647380 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:57.647206    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 20:10:58.646781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:58.646749    2531 patch_prober.go:28] interesting pod/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 20:10:58.646962 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:58.646793    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 20:10:59.646933 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:59.646894    2531 patch_prober.go:28] interesting pod/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 29 20:10:59.647382 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:10:59.646975    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 29 20:11:00.650884 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:00.650850    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:11:00.651350 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:00.651175    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:11:00.651763 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:00.651746    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:11:05.086014 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.085975    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"]
Jul 29 20:11:05.086489 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.086473    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy"
Jul 29 20:11:05.086534 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.086493    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy"
Jul 29 20:11:05.086534 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.086507    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy"
Jul 29 20:11:05.086534 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.086520    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy"
Jul 29 20:11:05.086630 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.086618    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy"
Jul 29 20:11:05.086664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.086629    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="e258c84e-8bd7-4aa3-b502-29b3ecb7fc89" containerName="istio-proxy"
Jul 29 20:11:05.089889 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.089872    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.093288 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.093267    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d3ceb2-openshift-default-dockercfg-vrn82\""
Jul 29 20:11:05.100636 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.100615    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"]
Jul 29 20:11:05.200351 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200316    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-certs\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200351 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200350    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-token\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200386    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-socket\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200409    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-envoy\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200441    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-podinfo\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200458    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k964p\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-kube-api-access-k964p\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200539    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-data\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200618 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200601    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-credential-socket\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.200857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.200670    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d910354a-92c1-4f40-a874-8ec41281b1bd-istiod-ca-cert\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.301790 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301756    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-data\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301810    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-credential-socket\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301844    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d910354a-92c1-4f40-a874-8ec41281b1bd-istiod-ca-cert\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301881    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-certs\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301903    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-token\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301940    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-socket\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301963    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-envoy\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.301996    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-podinfo\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.302024    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k964p\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-kube-api-access-k964p\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.302256    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-data\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.302502    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-socket\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.302553    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-credential-socket\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.302670    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d910354a-92c1-4f40-a874-8ec41281b1bd-istiod-ca-cert\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.302818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.302717    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-certs\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.304887 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.304859    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-envoy\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.305178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.305159    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-podinfo\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.311014 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.310982    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k964p\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-kube-api-access-k964p\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.311183 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.311165    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-token\") pod \"e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") " pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.401549 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.401468    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:05.542458 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.540829    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"]
Jul 29 20:11:05.543813 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:11:05.543781    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd910354a_92c1_4f40_a874_8ec41281b1bd.slice/crio-e6b92455f21d37040d2f9b64093efcd5b84a06048fb22f156d2bcc7bd0e2af7a WatchSource:0}: Error finding container e6b92455f21d37040d2f9b64093efcd5b84a06048fb22f156d2bcc7bd0e2af7a: Status 404 returned error can't find the container with id e6b92455f21d37040d2f9b64093efcd5b84a06048fb22f156d2bcc7bd0e2af7a
Jul 29 20:11:05.545987 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.545954    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:11:05.546080 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.546017    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:11:05.546127 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:05.546082    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:11:06.496429 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:06.496389    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" event={"ID":"d910354a-92c1-4f40-a874-8ec41281b1bd","Type":"ContainerStarted","Data":"378daf1e9d53bb7a0ef1a188c35b608372e54042d841ce87c8a5e4e321faa977"}
Jul 29 20:11:06.496829 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:06.496454    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" event={"ID":"d910354a-92c1-4f40-a874-8ec41281b1bd","Type":"ContainerStarted","Data":"e6b92455f21d37040d2f9b64093efcd5b84a06048fb22f156d2bcc7bd0e2af7a"}
Jul 29 20:11:06.522689 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:06.522640    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" podStartSLOduration=1.522625411 podStartE2EDuration="1.522625411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:11:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:11:06.519673912 +0000 UTC m=+2474.673932532" watchObservedRunningTime="2026-07-29 20:11:06.522625411 +0000 UTC m=+2474.676884085"
Jul 29 20:11:07.402676 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:07.402642    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:07.407559 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:07.407534    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:07.503393 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:07.503360    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:07.504462 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:07.504440    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:09.410551 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.410509    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"]
Jul 29 20:11:09.414142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.414122    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.416615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.416594    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-d3ceb2-dockercfg-fbjlk\""
Jul 29 20:11:09.416615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.416609    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-d3ceb2\""
Jul 29 20:11:09.422396 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.422019    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"]
Jul 29 20:11:09.438428 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.438404    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f6cf\" (UniqueName: \"kubernetes.io/projected/79b7688d-988a-47fa-9675-74b705fa4cd1-kube-api-access-8f6cf\") pod \"payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.438521 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.438506    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b7688d-988a-47fa-9675-74b705fa4cd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.539037 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.539002    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b7688d-988a-47fa-9675-74b705fa4cd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.539314 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.539288    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f6cf\" (UniqueName: \"kubernetes.io/projected/79b7688d-988a-47fa-9675-74b705fa4cd1-kube-api-access-8f6cf\") pod \"payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.539729 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.539710    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b7688d-988a-47fa-9675-74b705fa4cd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.550516 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.550492    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f6cf\" (UniqueName: \"kubernetes.io/projected/79b7688d-988a-47fa-9675-74b705fa4cd1-kube-api-access-8f6cf\") pod \"payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.725703 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.725664    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:09.863291 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:09.863262    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"]
Jul 29 20:11:09.865014 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:11:09.864986    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b7688d_988a_47fa_9675_74b705fa4cd1.slice/crio-69b572575fc47eaf2e3c3c3ba3be1179b853a4e3a9f787a51288f2b1d50e986e WatchSource:0}: Error finding container 69b572575fc47eaf2e3c3c3ba3be1179b853a4e3a9f787a51288f2b1d50e986e: Status 404 returned error can't find the container with id 69b572575fc47eaf2e3c3c3ba3be1179b853a4e3a9f787a51288f2b1d50e986e
Jul 29 20:11:10.519733 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:10.519700    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44" event={"ID":"79b7688d-988a-47fa-9675-74b705fa4cd1","Type":"ContainerStarted","Data":"e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798"}
Jul 29 20:11:10.520219 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:10.519761    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44" event={"ID":"79b7688d-988a-47fa-9675-74b705fa4cd1","Type":"ContainerStarted","Data":"69b572575fc47eaf2e3c3c3ba3be1179b853a4e3a9f787a51288f2b1d50e986e"}
Jul 29 20:11:10.520219 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:10.519803    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:10.538666 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:10.538621    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44" podStartSLOduration=1.5386068499999999 podStartE2EDuration="1.53860685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:11:10.536271039 +0000 UTC m=+2478.690529845" watchObservedRunningTime="2026-07-29 20:11:10.53860685 +0000 UTC m=+2478.692865470"
Jul 29 20:11:21.527320 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:21.527283    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:11:22.505250 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.505215    2531 patch_prober.go:28] interesting pod/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:11:22.505483 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.505280    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:11:22.580849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.580820    2531 generic.go:356] "Generic (PLEG): container finished" podID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerID="378daf1e9d53bb7a0ef1a188c35b608372e54042d841ce87c8a5e4e321faa977" exitCode=0
Jul 29 20:11:22.581238 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.580896    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" event={"ID":"d910354a-92c1-4f40-a874-8ec41281b1bd","Type":"ContainerDied","Data":"378daf1e9d53bb7a0ef1a188c35b608372e54042d841ce87c8a5e4e321faa977"}
Jul 29 20:11:22.581284 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.581264    2531 scope.go:117] "RemoveContainer" containerID="378daf1e9d53bb7a0ef1a188c35b608372e54042d841ce87c8a5e4e321faa977"
Jul 29 20:11:22.582304 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.582256    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:11:22.582404 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.582335    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:11:22.582404 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:22.582370    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:11:23.591111 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:23.591044    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" event={"ID":"d910354a-92c1-4f40-a874-8ec41281b1bd","Type":"ContainerStarted","Data":"773b2b8ae8e9ae1907269008534a1b5b14c794d9915cbde6ebeaeb5535a8da53"}
Jul 29 20:11:24.402136 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:24.402101    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:24.402339 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:24.402314    2531 patch_prober.go:28] interesting pod/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:11:24.402389 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:24.402365    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:11:25.402727 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:25.402688    2531 patch_prober.go:28] interesting pod/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:11:25.403227 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:25.402745    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:11:26.402800 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:26.402765    2531 patch_prober.go:28] interesting pod/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 29 20:11:26.403221 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:26.402828    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 29 20:11:27.406204 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:27.406171    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:27.406581 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:27.406431    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:27.407093 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:27.407078    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:11:45.943744 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:45.943657    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"]
Jul 29 20:11:45.944238 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:45.944173    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2" podUID="50e04ac2-d645-44f0-a7af-9a554ed5e15c" containerName="payload-pre-processing" containerID="cri-o://0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686" gracePeriod=30
Jul 29 20:11:46.202459 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.202404    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:11:46.375431 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.375402    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50e04ac2-d645-44f0-a7af-9a554ed5e15c-plugins-config-volume\") pod \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") "
Jul 29 20:11:46.375582 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.375507    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlb9d\" (UniqueName: \"kubernetes.io/projected/50e04ac2-d645-44f0-a7af-9a554ed5e15c-kube-api-access-rlb9d\") pod \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\" (UID: \"50e04ac2-d645-44f0-a7af-9a554ed5e15c\") "
Jul 29 20:11:46.375730 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.375711    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e04ac2-d645-44f0-a7af-9a554ed5e15c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50e04ac2-d645-44f0-a7af-9a554ed5e15c" (UID: "50e04ac2-d645-44f0-a7af-9a554ed5e15c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:11:46.377656 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.377628    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e04ac2-d645-44f0-a7af-9a554ed5e15c-kube-api-access-rlb9d" (OuterVolumeSpecName: "kube-api-access-rlb9d") pod "50e04ac2-d645-44f0-a7af-9a554ed5e15c" (UID: "50e04ac2-d645-44f0-a7af-9a554ed5e15c"). InnerVolumeSpecName "kube-api-access-rlb9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:11:46.476344 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.476264    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlb9d\" (UniqueName: \"kubernetes.io/projected/50e04ac2-d645-44f0-a7af-9a554ed5e15c-kube-api-access-rlb9d\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:46.476344 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.476290    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50e04ac2-d645-44f0-a7af-9a554ed5e15c-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:46.715020 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.714985    2531 generic.go:356] "Generic (PLEG): container finished" podID="50e04ac2-d645-44f0-a7af-9a554ed5e15c" containerID="0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686" exitCode=0
Jul 29 20:11:46.715237 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.715034    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"
Jul 29 20:11:46.715237 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.715081    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2" event={"ID":"50e04ac2-d645-44f0-a7af-9a554ed5e15c","Type":"ContainerDied","Data":"0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686"}
Jul 29 20:11:46.715237 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.715123    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2" event={"ID":"50e04ac2-d645-44f0-a7af-9a554ed5e15c","Type":"ContainerDied","Data":"715ae7224c79e2b44b51fda170cd556a982ae77c690dd49ff540374ea692f6f4"}
Jul 29 20:11:46.715237 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.715145    2531 scope.go:117] "RemoveContainer" containerID="0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686"
Jul 29 20:11:46.723914 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.723899    2531 scope.go:117] "RemoveContainer" containerID="0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686"
Jul 29 20:11:46.724189 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:11:46.724167    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686\": container with ID starting with 0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686 not found: ID does not exist" containerID="0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686"
Jul 29 20:11:46.724242 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.724202    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686"} err="failed to get container status \"0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686\": rpc error: code = NotFound desc = could not find container \"0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686\": container with ID starting with 0d463e7e8765812a94ac8d637387d773833afc32d5790a436c5c73b89e116686 not found: ID does not exist"
Jul 29 20:11:46.738539 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.738464    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"]
Jul 29 20:11:46.740298 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:46.740280    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-78b35e-866bfcd844-cjcc2"]
Jul 29 20:11:48.372035 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:48.372005    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50e04ac2-d645-44f0-a7af-9a554ed5e15c" path="/var/lib/kubelet/pods/50e04ac2-d645-44f0-a7af-9a554ed5e15c/volumes"
Jul 29 20:11:52.571856 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:52.571829    2531 scope.go:117] "RemoveContainer" containerID="49a52b857a713b80048f9a4d51752747ff9456f8ff9d2e860926640e44c27b49"
Jul 29 20:11:52.840892 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:52.840810    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"]
Jul 29 20:11:52.841149 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:52.841117    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy" containerID="cri-o://a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc" gracePeriod=30
Jul 29 20:11:53.199247 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.199212    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"]
Jul 29 20:11:53.199598 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.199582    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e04ac2-d645-44f0-a7af-9a554ed5e15c" containerName="payload-pre-processing"
Jul 29 20:11:53.199690 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.199603    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e04ac2-d645-44f0-a7af-9a554ed5e15c" containerName="payload-pre-processing"
Jul 29 20:11:53.199746 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.199687    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e04ac2-d645-44f0-a7af-9a554ed5e15c" containerName="payload-pre-processing"
Jul 29 20:11:53.210102 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.210075    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"]
Jul 29 20:11:53.210259 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.210159    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"
Jul 29 20:11:53.212741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.212718    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:11:53.212855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.212823    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 20:11:53.334745 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.334711    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d94c02-4c82-464b-8de7-8a071c4dfb0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv\" (UID: \"70d94c02-4c82-464b-8de7-8a071c4dfb0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"
Jul 29 20:11:53.436100 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.436067    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d94c02-4c82-464b-8de7-8a071c4dfb0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv\" (UID: \"70d94c02-4c82-464b-8de7-8a071c4dfb0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"
Jul 29 20:11:53.436733 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.436707    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d94c02-4c82-464b-8de7-8a071c4dfb0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv\" (UID: \"70d94c02-4c82-464b-8de7-8a071c4dfb0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"
Jul 29 20:11:53.520643 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.520571    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"
Jul 29 20:11:53.654942 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.654918    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"]
Jul 29 20:11:53.656507 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:11:53.656469    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d94c02_4c82_464b_8de7_8a071c4dfb0a.slice/crio-1c7a2190e52bff7088dc6f5c46fef0ec274574e15fb8b7dbccbca7d604091c25 WatchSource:0}: Error finding container 1c7a2190e52bff7088dc6f5c46fef0ec274574e15fb8b7dbccbca7d604091c25: Status 404 returned error can't find the container with id 1c7a2190e52bff7088dc6f5c46fef0ec274574e15fb8b7dbccbca7d604091c25
Jul 29 20:11:53.750648 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:53.750612    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv" event={"ID":"70d94c02-4c82-464b-8de7-8a071c4dfb0a","Type":"ContainerStarted","Data":"1c7a2190e52bff7088dc6f5c46fef0ec274574e15fb8b7dbccbca7d604091c25"}
Jul 29 20:11:54.756830 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:54.756798    2531 generic.go:356] "Generic (PLEG): container finished" podID="70d94c02-4c82-464b-8de7-8a071c4dfb0a" containerID="51ce7a2f2b304dd6ac50343b28e14b186b22d71b8906a1db502b6a01843891e7" exitCode=0
Jul 29 20:11:54.757253 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:54.756852    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv" event={"ID":"70d94c02-4c82-464b-8de7-8a071c4dfb0a","Type":"ContainerDied","Data":"51ce7a2f2b304dd6ac50343b28e14b186b22d71b8906a1db502b6a01843891e7"}
Jul 29 20:11:55.889146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:55.889124    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"
Jul 29 20:11:55.954895 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:55.954868    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d94c02-4c82-464b-8de7-8a071c4dfb0a-maas-api-service-ca\") pod \"70d94c02-4c82-464b-8de7-8a071c4dfb0a\" (UID: \"70d94c02-4c82-464b-8de7-8a071c4dfb0a\") "
Jul 29 20:11:55.955268 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:55.955246    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d94c02-4c82-464b-8de7-8a071c4dfb0a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70d94c02-4c82-464b-8de7-8a071c4dfb0a" (UID: "70d94c02-4c82-464b-8de7-8a071c4dfb0a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:11:56.055670 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:56.055582    2531 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d94c02-4c82-464b-8de7-8a071c4dfb0a-maas-api-service-ca\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:56.767716 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:56.767685    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"
Jul 29 20:11:56.767928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:56.767725    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv" event={"ID":"70d94c02-4c82-464b-8de7-8a071c4dfb0a","Type":"ContainerDied","Data":"1c7a2190e52bff7088dc6f5c46fef0ec274574e15fb8b7dbccbca7d604091c25"}
Jul 29 20:11:56.767928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:56.767773    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c7a2190e52bff7088dc6f5c46fef0ec274574e15fb8b7dbccbca7d604091c25"
Jul 29 20:11:58.088302 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.088278    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:11:58.170075 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.169956    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbbf9\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-kube-api-access-dbbf9\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170075 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170011    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-token\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170075 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170038    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-podinfo\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170084    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-credential-socket\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170120    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-certs\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170157    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-socket\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170206    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdf8790b-c632-4904-bf82-feff572ad3fc-istiod-ca-cert\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170268    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-data\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170349 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170299    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-envoy\") pod \"cdf8790b-c632-4904-bf82-feff572ad3fc\" (UID: \"cdf8790b-c632-4904-bf82-feff572ad3fc\") "
Jul 29 20:11:58.170667 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170399    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:11:58.170667 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170480    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:11:58.170667 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170638    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.170667 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170661    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.170877 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170761    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf8790b-c632-4904-bf82-feff572ad3fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:11:58.170877 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.170832    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:11:58.171605 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.171580    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:11:58.172472 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.172455    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:11:58.172538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.172524    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:11:58.172929 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.172908    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-kube-api-access-dbbf9" (OuterVolumeSpecName: "kube-api-access-dbbf9") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "kube-api-access-dbbf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:11:58.172989 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.172920    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cdf8790b-c632-4904-bf82-feff572ad3fc" (UID: "cdf8790b-c632-4904-bf82-feff572ad3fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:11:58.271114 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.271036    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbbf9\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-kube-api-access-dbbf9\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.271114 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.271103    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.271114 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.271113    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.271114 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.271121    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.271114 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.271130    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cdf8790b-c632-4904-bf82-feff572ad3fc-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.271427 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.271138    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.271427 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.271147    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cdf8790b-c632-4904-bf82-feff572ad3fc-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:11:58.777962 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.777924    2531 generic.go:356] "Generic (PLEG): container finished" podID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerID="a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc" exitCode=0
Jul 29 20:11:58.778149 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.777980    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"
Jul 29 20:11:58.778149 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.778006    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" event={"ID":"cdf8790b-c632-4904-bf82-feff572ad3fc","Type":"ContainerDied","Data":"a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc"}
Jul 29 20:11:58.778149 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.778099    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64" event={"ID":"cdf8790b-c632-4904-bf82-feff572ad3fc","Type":"ContainerDied","Data":"258f4812722260cad873a96471dfe9b3173763e07c30e688a9b2369e70473d2e"}
Jul 29 20:11:58.778149 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.778125    2531 scope.go:117] "RemoveContainer" containerID="a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc"
Jul 29 20:11:58.786775 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.786757    2531 scope.go:117] "RemoveContainer" containerID="29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee"
Jul 29 20:11:58.794639 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.794475    2531 scope.go:117] "RemoveContainer" containerID="a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc"
Jul 29 20:11:58.794885 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:11:58.794838    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc\": container with ID starting with a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc not found: ID does not exist" containerID="a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc"
Jul 29 20:11:58.795008 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.794897    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc"} err="failed to get container status \"a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc\": rpc error: code = NotFound desc = could not find container \"a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc\": container with ID starting with a7bba1b81c2bc9ce0e95559e087feb0241f38d7bc81095f2e52c5707e10e48fc not found: ID does not exist"
Jul 29 20:11:58.795008 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.794920    2531 scope.go:117] "RemoveContainer" containerID="29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee"
Jul 29 20:11:58.795233 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:11:58.795215    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee\": container with ID starting with 29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee not found: ID does not exist" containerID="29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee"
Jul 29 20:11:58.795280 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.795240    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee"} err="failed to get container status \"29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee\": rpc error: code = NotFound desc = could not find container \"29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee\": container with ID starting with 29a75cb8ec75265c541d96aa0ade51cb3b9ac97c5e65510d25261850bf058fee not found: ID does not exist"
Jul 29 20:11:58.796923 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.796905    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"]
Jul 29 20:11:58.800891 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:11:58.800873    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-78b35e-openshift-default-74bdddf6c6-nmr64"]
Jul 29 20:12:00.371877 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:00.371841    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" path="/var/lib/kubelet/pods/cdf8790b-c632-4904-bf82-feff572ad3fc/volumes"
Jul 29 20:12:08.836383 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:08.836338    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"]
Jul 29 20:12:08.836823 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:08.836557    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44" podUID="79b7688d-988a-47fa-9675-74b705fa4cd1" containerName="payload-pre-processing" containerID="cri-o://e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798" gracePeriod=30
Jul 29 20:12:08.990979 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:08.990942    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"]
Jul 29 20:12:08.996501 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:08.996467    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d3ceb2-5xptv"]
Jul 29 20:12:09.089823 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.089752    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:12:09.157372 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.157342    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f6cf\" (UniqueName: \"kubernetes.io/projected/79b7688d-988a-47fa-9675-74b705fa4cd1-kube-api-access-8f6cf\") pod \"79b7688d-988a-47fa-9675-74b705fa4cd1\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") "
Jul 29 20:12:09.157372 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.157376    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b7688d-988a-47fa-9675-74b705fa4cd1-plugins-config-volume\") pod \"79b7688d-988a-47fa-9675-74b705fa4cd1\" (UID: \"79b7688d-988a-47fa-9675-74b705fa4cd1\") "
Jul 29 20:12:09.157772 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.157751    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79b7688d-988a-47fa-9675-74b705fa4cd1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79b7688d-988a-47fa-9675-74b705fa4cd1" (UID: "79b7688d-988a-47fa-9675-74b705fa4cd1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:12:09.159582 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.159560    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b7688d-988a-47fa-9675-74b705fa4cd1-kube-api-access-8f6cf" (OuterVolumeSpecName: "kube-api-access-8f6cf") pod "79b7688d-988a-47fa-9675-74b705fa4cd1" (UID: "79b7688d-988a-47fa-9675-74b705fa4cd1"). InnerVolumeSpecName "kube-api-access-8f6cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:12:09.258915 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.258881    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f6cf\" (UniqueName: \"kubernetes.io/projected/79b7688d-988a-47fa-9675-74b705fa4cd1-kube-api-access-8f6cf\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:09.258915 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.258911    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79b7688d-988a-47fa-9675-74b705fa4cd1-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:09.833627 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.833591    2531 generic.go:356] "Generic (PLEG): container finished" podID="79b7688d-988a-47fa-9675-74b705fa4cd1" containerID="e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798" exitCode=0
Jul 29 20:12:09.833830 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.833643    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"
Jul 29 20:12:09.833830 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.833671    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44" event={"ID":"79b7688d-988a-47fa-9675-74b705fa4cd1","Type":"ContainerDied","Data":"e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798"}
Jul 29 20:12:09.833830 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.833720    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44" event={"ID":"79b7688d-988a-47fa-9675-74b705fa4cd1","Type":"ContainerDied","Data":"69b572575fc47eaf2e3c3c3ba3be1179b853a4e3a9f787a51288f2b1d50e986e"}
Jul 29 20:12:09.833830 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.833743    2531 scope.go:117] "RemoveContainer" containerID="e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798"
Jul 29 20:12:09.845472 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.845243    2531 scope.go:117] "RemoveContainer" containerID="e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798"
Jul 29 20:12:09.845693 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:12:09.845509    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798\": container with ID starting with e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798 not found: ID does not exist" containerID="e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798"
Jul 29 20:12:09.845693 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.845535    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798"} err="failed to get container status \"e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798\": rpc error: code = NotFound desc = could not find container \"e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798\": container with ID starting with e019bc7399b56ba45b0f1b5207f56110f18afe1443c5f578bb73e7b4d8665798 not found: ID does not exist"
Jul 29 20:12:09.859330 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.859298    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"]
Jul 29 20:12:09.863681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:09.863658    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-d3ceb2-847fbcb876-ksw44"]
Jul 29 20:12:10.375628 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:10.375596    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d94c02-4c82-464b-8de7-8a071c4dfb0a" path="/var/lib/kubelet/pods/70d94c02-4c82-464b-8de7-8a071c4dfb0a/volumes"
Jul 29 20:12:10.375942 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:10.375927    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b7688d-988a-47fa-9675-74b705fa4cd1" path="/var/lib/kubelet/pods/79b7688d-988a-47fa-9675-74b705fa4cd1/volumes"
Jul 29 20:12:15.729031 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:15.728998    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"]
Jul 29 20:12:15.729524 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:15.729271    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy" containerID="cri-o://773b2b8ae8e9ae1907269008534a1b5b14c794d9915cbde6ebeaeb5535a8da53" gracePeriod=30
Jul 29 20:12:16.587498 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587459    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"]
Jul 29 20:12:16.587848 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587831    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy"
Jul 29 20:12:16.587935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587851    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy"
Jul 29 20:12:16.587935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587869    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b7688d-988a-47fa-9675-74b705fa4cd1" containerName="payload-pre-processing"
Jul 29 20:12:16.587935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587877    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b7688d-988a-47fa-9675-74b705fa4cd1" containerName="payload-pre-processing"
Jul 29 20:12:16.587935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587888    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d94c02-4c82-464b-8de7-8a071c4dfb0a" containerName="revoke-keys"
Jul 29 20:12:16.587935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587897    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d94c02-4c82-464b-8de7-8a071c4dfb0a" containerName="revoke-keys"
Jul 29 20:12:16.587935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587912    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy"
Jul 29 20:12:16.587935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.587920    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy"
Jul 29 20:12:16.588310 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.588016    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy"
Jul 29 20:12:16.588310 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.588030    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdf8790b-c632-4904-bf82-feff572ad3fc" containerName="istio-proxy"
Jul 29 20:12:16.588310 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.588041    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b7688d-988a-47fa-9675-74b705fa4cd1" containerName="payload-pre-processing"
Jul 29 20:12:16.588310 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.588068    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d94c02-4c82-464b-8de7-8a071c4dfb0a" containerName="revoke-keys"
Jul 29 20:12:16.592433 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.592412    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.594792 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.594775    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7d4a80-openshift-default-dockercfg-p2jf8\""
Jul 29 20:12:16.604701 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.604674    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"]
Jul 29 20:12:16.615467 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615445    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-podinfo\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615566 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615472    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-token\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615566 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615498    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-certs\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615657 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615555    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-socket\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615657 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615594    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-data\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615657 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615645    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqrw\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-kube-api-access-6lqrw\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615757 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615671    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-credential-socket\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615757 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615715    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istiod-ca-cert\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.615757 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.615745    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-envoy\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716361 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716318    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istiod-ca-cert\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716373    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-envoy\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716430    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-podinfo\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716451    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-token\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716488    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-certs\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716521    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-socket\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716544    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-data\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716570    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqrw\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-kube-api-access-6lqrw\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.716616 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716596    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-credential-socket\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.717037 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716918    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-socket\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.717037 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.716988    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-data\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.717037 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.717001    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-credential-socket\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.717191 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.717169    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istiod-ca-cert\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.717254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.717236    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-certs\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.718906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.718885    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-envoy\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.719113 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.719095    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-podinfo\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.724815 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.724788    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-token\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.725146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.725115    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqrw\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-kube-api-access-6lqrw\") pod \"e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") " pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:16.902895 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:16.902801    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:17.039447 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.039417    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"]
Jul 29 20:12:17.040798 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:12:17.040771    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f9c10b_20c5_4258_ad31_4d2b2e09365c.slice/crio-08521553e9ed7b26afd84ec2bbadd09764ef5388c6a650a0249ebad21f4f8365 WatchSource:0}: Error finding container 08521553e9ed7b26afd84ec2bbadd09764ef5388c6a650a0249ebad21f4f8365: Status 404 returned error can't find the container with id 08521553e9ed7b26afd84ec2bbadd09764ef5388c6a650a0249ebad21f4f8365
Jul 29 20:12:17.042908 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.042873    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:17.043002 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.042939    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:17.043002 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.042972    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:17.873227 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.873190    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" event={"ID":"68f9c10b-20c5-4258-ad31-4d2b2e09365c","Type":"ContainerStarted","Data":"6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5"}
Jul 29 20:12:17.873417 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.873251    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" event={"ID":"68f9c10b-20c5-4258-ad31-4d2b2e09365c","Type":"ContainerStarted","Data":"08521553e9ed7b26afd84ec2bbadd09764ef5388c6a650a0249ebad21f4f8365"}
Jul 29 20:12:17.896841 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.896792    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" podStartSLOduration=1.896776888 podStartE2EDuration="1.896776888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:12:17.895453488 +0000 UTC m=+2546.049712118" watchObservedRunningTime="2026-07-29 20:12:17.896776888 +0000 UTC m=+2546.051035507"
Jul 29 20:12:17.903195 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:17.903170    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:18.908483 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:18.908455    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:19.884528 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:19.884483    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:19.885596 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:19.885575    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:20.891456 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:20.891423    2531 generic.go:356] "Generic (PLEG): container finished" podID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerID="773b2b8ae8e9ae1907269008534a1b5b14c794d9915cbde6ebeaeb5535a8da53" exitCode=0
Jul 29 20:12:20.891838 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:20.891495    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" event={"ID":"d910354a-92c1-4f40-a874-8ec41281b1bd","Type":"ContainerDied","Data":"773b2b8ae8e9ae1907269008534a1b5b14c794d9915cbde6ebeaeb5535a8da53"}
Jul 29 20:12:20.891838 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:20.891587    2531 scope.go:117] "RemoveContainer" containerID="378daf1e9d53bb7a0ef1a188c35b608372e54042d841ce87c8a5e4e321faa977"
Jul 29 20:12:20.987522 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:20.987499    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:12:21.054913 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.054838    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-podinfo\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.054913 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.054872    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k964p\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-kube-api-access-k964p\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.054913 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.054892    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-socket\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.054913 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.054909    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-credential-socket\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.055273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.054981    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-data\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.055273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055072    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-certs\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.055273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055144    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d910354a-92c1-4f40-a874-8ec41281b1bd-istiod-ca-cert\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.055273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055179    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-envoy\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.055273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055218    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-token\") pod \"d910354a-92c1-4f40-a874-8ec41281b1bd\" (UID: \"d910354a-92c1-4f40-a874-8ec41281b1bd\") "
Jul 29 20:12:21.055273 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055231    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:21.055573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055247    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:21.055573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055505    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.055573 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055527    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.055840 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055784    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d910354a-92c1-4f40-a874-8ec41281b1bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:12:21.055969 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.055855    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:21.056214 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.056188    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:21.057267 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.057242    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-kube-api-access-k964p" (OuterVolumeSpecName: "kube-api-access-k964p") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "kube-api-access-k964p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:12:21.057453 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.057432    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:12:21.057453 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.057434    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:12:21.057571 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.057435    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d910354a-92c1-4f40-a874-8ec41281b1bd" (UID: "d910354a-92c1-4f40-a874-8ec41281b1bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:12:21.156777 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.156744    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.156777 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.156772    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k964p\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-kube-api-access-k964p\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.156995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.156797    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.156995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.156806    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.156995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.156814    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d910354a-92c1-4f40-a874-8ec41281b1bd-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.156995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.156822    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.156995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.156829    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d910354a-92c1-4f40-a874-8ec41281b1bd-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:12:21.897420 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.897391    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"
Jul 29 20:12:21.897898 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.897439    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg" event={"ID":"d910354a-92c1-4f40-a874-8ec41281b1bd","Type":"ContainerDied","Data":"e6b92455f21d37040d2f9b64093efcd5b84a06048fb22f156d2bcc7bd0e2af7a"}
Jul 29 20:12:21.897898 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.897489    2531 scope.go:117] "RemoveContainer" containerID="773b2b8ae8e9ae1907269008534a1b5b14c794d9915cbde6ebeaeb5535a8da53"
Jul 29 20:12:21.920159 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.920133    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"]
Jul 29 20:12:21.926267 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:21.926244    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d3ceb2-openshift-default-ddf98b7d8-tqhhg"]
Jul 29 20:12:22.372211 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:22.372183    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" path="/var/lib/kubelet/pods/d910354a-92c1-4f40-a874-8ec41281b1bd/volumes"
Jul 29 20:12:33.956960 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:33.956924    2531 generic.go:356] "Generic (PLEG): container finished" podID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerID="6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5" exitCode=0
Jul 29 20:12:33.957422 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:33.956997    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" event={"ID":"68f9c10b-20c5-4258-ad31-4d2b2e09365c","Type":"ContainerDied","Data":"6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5"}
Jul 29 20:12:33.957422 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:33.957382    2531 scope.go:117] "RemoveContainer" containerID="6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5"
Jul 29 20:12:33.958361 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:33.958332    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:33.958473 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:33.958414    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:33.958473 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:33.958464    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:34.885430 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:34.885393    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:34.963630 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:34.963598    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" event={"ID":"68f9c10b-20c5-4258-ad31-4d2b2e09365c","Type":"ContainerStarted","Data":"aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74"}
Jul 29 20:12:35.903750 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:35.903705    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:35.905005 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:35.904978    2531 patch_prober.go:28] interesting pod/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:12:35.905146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:35.905028    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:12:36.903642 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:36.903599    2531 patch_prober.go:28] interesting pod/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:12:36.904186 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:36.903681    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:12:37.903630 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:37.903598    2531 patch_prober.go:28] interesting pod/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:12:37.903813 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:37.903654    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:12:38.903247 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:38.903212    2531 patch_prober.go:28] interesting pod/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 29 20:12:38.903426 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:38.903269    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 29 20:12:39.907335 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:39.907301    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:39.907757 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:39.907591    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:39.908260 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:39.908243    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:12:45.345198 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.345166    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"]
Jul 29 20:12:45.345681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.345515    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy"
Jul 29 20:12:45.345681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.345535    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy"
Jul 29 20:12:45.345681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.345562    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy"
Jul 29 20:12:45.345681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.345571    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy"
Jul 29 20:12:45.345681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.345649    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy"
Jul 29 20:12:45.345681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.345661    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="d910354a-92c1-4f40-a874-8ec41281b1bd" containerName="istio-proxy"
Jul 29 20:12:45.348000 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.347980    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.350710 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.350688    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1a1eaa-openshift-default-dockercfg-kjmct\""
Jul 29 20:12:45.361571 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.361551    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"]
Jul 29 20:12:45.480145 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480099    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-socket\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480145 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480145    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-token\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480226    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istiod-ca-cert\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480258    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2q4t\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-kube-api-access-j2q4t\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480277    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-certs\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480303    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-data\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480338    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-envoy\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480384 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480362    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-podinfo\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.480606 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.480399    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-credential-socket\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.581733 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.581702    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-token\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.581914 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.581753    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istiod-ca-cert\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.581914 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.581770    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2q4t\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-kube-api-access-j2q4t\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.581914 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.581788    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-certs\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.581914 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.581904    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-data\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.581972    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-envoy\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582003    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-podinfo\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582039    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-credential-socket\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582218    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-socket\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582240    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-certs\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582483 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582448    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-data\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582577 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582520    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-credential-socket\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582633 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582590    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-socket\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.582776 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.582756    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istiod-ca-cert\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.584479 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.584459    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-envoy\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.584833 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.584817    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-podinfo\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.590799 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.590769    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2q4t\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-kube-api-access-j2q4t\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.590894 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.590837    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-token\") pod \"e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") " pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.658648 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.658570    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:45.794314 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.794289    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"]
Jul 29 20:12:45.796117 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:12:45.796087    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5345f80_0e31_45d3_a1ac_ab6fefe9b3e5.slice/crio-96a3736b8330f267ff4fd7aff65e46ba458655080cb4442e2f0c64b5ac0a992a WatchSource:0}: Error finding container 96a3736b8330f267ff4fd7aff65e46ba458655080cb4442e2f0c64b5ac0a992a: Status 404 returned error can't find the container with id 96a3736b8330f267ff4fd7aff65e46ba458655080cb4442e2f0c64b5ac0a992a
Jul 29 20:12:45.798424 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.798387    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:45.798501 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.798469    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:45.798539 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:45.798511    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:12:46.026178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:46.026141    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" event={"ID":"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5","Type":"ContainerStarted","Data":"b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9"}
Jul 29 20:12:46.026377 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:46.026193    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" event={"ID":"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5","Type":"ContainerStarted","Data":"96a3736b8330f267ff4fd7aff65e46ba458655080cb4442e2f0c64b5ac0a992a"}
Jul 29 20:12:46.047840 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:46.047778    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" podStartSLOduration=1.04776379 podStartE2EDuration="1.04776379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:12:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:12:46.04583792 +0000 UTC m=+2574.200096540" watchObservedRunningTime="2026-07-29 20:12:46.04776379 +0000 UTC m=+2574.202022409"
Jul 29 20:12:46.659735 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:46.659696    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:46.664809 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:46.664784    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:47.031189 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:47.031158    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:47.032207 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:47.032189    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:12:48.794393 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:48.794366    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"]
Jul 29 20:12:48.796522 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:48.796507    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:48.798783 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:48.798764    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-1a1eaa\""
Jul 29 20:12:48.805719 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:48.805700    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"]
Jul 29 20:12:48.913230 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:48.913169    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbzhs\" (UniqueName: \"kubernetes.io/projected/db3a4024-7bfc-4a1f-b2f5-3936f8208392-kube-api-access-jbzhs\") pod \"payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:48.913395 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:48.913329    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db3a4024-7bfc-4a1f-b2f5-3936f8208392-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:49.014343 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:49.014294    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db3a4024-7bfc-4a1f-b2f5-3936f8208392-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:49.014520 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:49.014374    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbzhs\" (UniqueName: \"kubernetes.io/projected/db3a4024-7bfc-4a1f-b2f5-3936f8208392-kube-api-access-jbzhs\") pod \"payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:49.014948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:49.014928    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db3a4024-7bfc-4a1f-b2f5-3936f8208392-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:49.023533 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:49.023510    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbzhs\" (UniqueName: \"kubernetes.io/projected/db3a4024-7bfc-4a1f-b2f5-3936f8208392-kube-api-access-jbzhs\") pod \"payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:49.108250 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:49.108215    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:49.241393 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:49.241369    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"]
Jul 29 20:12:49.243343 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:12:49.243314    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3a4024_7bfc_4a1f_b2f5_3936f8208392.slice/crio-d173102cdbad26c2e6baae42af082e8d8a659b8ce11409261b592c6a067dfb9b WatchSource:0}: Error finding container d173102cdbad26c2e6baae42af082e8d8a659b8ce11409261b592c6a067dfb9b: Status 404 returned error can't find the container with id d173102cdbad26c2e6baae42af082e8d8a659b8ce11409261b592c6a067dfb9b
Jul 29 20:12:50.048710 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:50.048675    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd" event={"ID":"db3a4024-7bfc-4a1f-b2f5-3936f8208392","Type":"ContainerStarted","Data":"6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94"}
Jul 29 20:12:50.049159 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:50.048726    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd" event={"ID":"db3a4024-7bfc-4a1f-b2f5-3936f8208392","Type":"ContainerStarted","Data":"d173102cdbad26c2e6baae42af082e8d8a659b8ce11409261b592c6a067dfb9b"}
Jul 29 20:12:50.049159 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:50.048819    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:12:50.071932 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:12:50.071879    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd" podStartSLOduration=2.071863422 podStartE2EDuration="2.071863422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:12:50.069889265 +0000 UTC m=+2578.224147885" watchObservedRunningTime="2026-07-29 20:12:50.071863422 +0000 UTC m=+2578.226122041"
Jul 29 20:13:01.055775 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:01.055726    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:13:03.031716 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:03.031678    2531 patch_prober.go:28] interesting pod/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 20:13:03.032240 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:03.031738    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 20:13:04.124113 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:04.124079    2531 generic.go:356] "Generic (PLEG): container finished" podID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerID="b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9" exitCode=0
Jul 29 20:13:04.124566 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:04.124150    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" event={"ID":"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5","Type":"ContainerDied","Data":"b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9"}
Jul 29 20:13:04.124566 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:04.124541    2531 scope.go:117] "RemoveContainer" containerID="b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9"
Jul 29 20:13:04.125547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:04.125516    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:13:04.125615 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:04.125600    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:13:04.125659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:04.125631    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:13:05.130374 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:05.130340    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" event={"ID":"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5","Type":"ContainerStarted","Data":"954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc"}
Jul 29 20:13:05.659752 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:05.659716    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:13:05.659989 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:05.659968    2531 patch_prober.go:28] interesting pod/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 29 20:13:05.660045 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:05.660022    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 29 20:13:06.659590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:06.659558    2531 patch_prober.go:28] interesting pod/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 29 20:13:06.659963 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:06.659612    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 29 20:13:07.658921 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:07.658885    2531 patch_prober.go:28] interesting pod/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 29 20:13:07.659135 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:07.658948    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 29 20:13:08.659734 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:08.659698    2531 patch_prober.go:28] interesting pod/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 29 20:13:08.660158 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:08.659755    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 29 20:13:09.663099 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:09.663068    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:13:09.663495 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:09.663338    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:13:09.663932 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:09.663917    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:13:44.585846 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.585808    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"]
Jul 29 20:13:44.589102 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.589087    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.592168 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.592145    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"default-dockercfg-x7glc\""
Jul 29 20:13:44.593242 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.593225    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"kube-root-ca.crt\""
Jul 29 20:13:44.593340 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.593239    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"openshift-service-ca.crt\""
Jul 29 20:13:44.593340 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.593318    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"auth-test-model-1a1eaa-kserve-self-signed-certs\""
Jul 29 20:13:44.597976 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.597952    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"]
Jul 29 20:13:44.601445 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.601425    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-model-cache\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.601569 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.601465    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-dshm\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.601569 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.601483    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04cc886-ddc6-43df-b249-144b098d2ddf-tls-certs\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.601750 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.601582    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5k9\" (UniqueName: \"kubernetes.io/projected/a04cc886-ddc6-43df-b249-144b098d2ddf-kube-api-access-8f5k9\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.601750 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.601606    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-tmp-dir\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.601750 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.601624    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-home\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702262 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702229    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5k9\" (UniqueName: \"kubernetes.io/projected/a04cc886-ddc6-43df-b249-144b098d2ddf-kube-api-access-8f5k9\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702262 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702262    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-tmp-dir\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702460 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702279    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-home\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702460 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702335    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-model-cache\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702460 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702407    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-dshm\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702460 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702432    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04cc886-ddc6-43df-b249-144b098d2ddf-tls-certs\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702648 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702631    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-home\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702700 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702677    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-tmp-dir\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.702741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.702697    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-model-cache\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.704570 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.704545    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-dshm\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.704894 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.704875    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04cc886-ddc6-43df-b249-144b098d2ddf-tls-certs\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.711857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.711838    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5k9\" (UniqueName: \"kubernetes.io/projected/a04cc886-ddc6-43df-b249-144b098d2ddf-kube-api-access-8f5k9\") pod \"auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") " pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:44.898792 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:44.898695    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:45.034304 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:45.034275    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"]
Jul 29 20:13:45.035841 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:13:45.035816    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda04cc886_ddc6_43df_b249_144b098d2ddf.slice/crio-38f7d9520e19e21484508b91ed8bd6f2b7dbfd0fcb96bd8388b48934a0498d9d WatchSource:0}: Error finding container 38f7d9520e19e21484508b91ed8bd6f2b7dbfd0fcb96bd8388b48934a0498d9d: Status 404 returned error can't find the container with id 38f7d9520e19e21484508b91ed8bd6f2b7dbfd0fcb96bd8388b48934a0498d9d
Jul 29 20:13:45.320210 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:45.320175    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4" event={"ID":"a04cc886-ddc6-43df-b249-144b098d2ddf","Type":"ContainerStarted","Data":"87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4"}
Jul 29 20:13:45.320210 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:45.320214    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4" event={"ID":"a04cc886-ddc6-43df-b249-144b098d2ddf","Type":"ContainerStarted","Data":"38f7d9520e19e21484508b91ed8bd6f2b7dbfd0fcb96bd8388b48934a0498d9d"}
Jul 29 20:13:45.338791 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:45.338741    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4" podStartSLOduration=1.338726909 podStartE2EDuration="1.338726909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:13:45.337898954 +0000 UTC m=+2633.492157574" watchObservedRunningTime="2026-07-29 20:13:45.338726909 +0000 UTC m=+2633.492985825"
Jul 29 20:13:54.898928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:54.898892    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:54.899570 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:54.898947    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:54.911574 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:54.911553    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:13:55.378461 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:13:55.378434    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:18:22.195155 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:22.195125    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"]
Jul 29 20:18:37.214826 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.214775    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4" podUID="a04cc886-ddc6-43df-b249-144b098d2ddf" containerName="main" containerID="cri-o://87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4" gracePeriod=45
Jul 29 20:18:37.474641 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.474586    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:18:37.629654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.629607    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04cc886-ddc6-43df-b249-144b098d2ddf-tls-certs\") pod \"a04cc886-ddc6-43df-b249-144b098d2ddf\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") "
Jul 29 20:18:37.629857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.629673    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-model-cache\") pod \"a04cc886-ddc6-43df-b249-144b098d2ddf\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") "
Jul 29 20:18:37.629857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.629718    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f5k9\" (UniqueName: \"kubernetes.io/projected/a04cc886-ddc6-43df-b249-144b098d2ddf-kube-api-access-8f5k9\") pod \"a04cc886-ddc6-43df-b249-144b098d2ddf\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") "
Jul 29 20:18:37.629857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.629760    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-tmp-dir\") pod \"a04cc886-ddc6-43df-b249-144b098d2ddf\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") "
Jul 29 20:18:37.629857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.629797    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-dshm\") pod \"a04cc886-ddc6-43df-b249-144b098d2ddf\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") "
Jul 29 20:18:37.629857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.629834    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-home\") pod \"a04cc886-ddc6-43df-b249-144b098d2ddf\" (UID: \"a04cc886-ddc6-43df-b249-144b098d2ddf\") "
Jul 29 20:18:37.630185 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.629959    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-model-cache" (OuterVolumeSpecName: "model-cache") pod "a04cc886-ddc6-43df-b249-144b098d2ddf" (UID: "a04cc886-ddc6-43df-b249-144b098d2ddf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:18:37.630185 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.630176    2531 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-model-cache\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:18:37.630292 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.630210    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-home" (OuterVolumeSpecName: "home") pod "a04cc886-ddc6-43df-b249-144b098d2ddf" (UID: "a04cc886-ddc6-43df-b249-144b098d2ddf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:18:37.630292 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.630260    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a04cc886-ddc6-43df-b249-144b098d2ddf" (UID: "a04cc886-ddc6-43df-b249-144b098d2ddf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:18:37.632191 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.632171    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a04cc886-ddc6-43df-b249-144b098d2ddf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a04cc886-ddc6-43df-b249-144b098d2ddf" (UID: "a04cc886-ddc6-43df-b249-144b098d2ddf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:18:37.632630 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.632593    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-dshm" (OuterVolumeSpecName: "dshm") pod "a04cc886-ddc6-43df-b249-144b098d2ddf" (UID: "a04cc886-ddc6-43df-b249-144b098d2ddf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:18:37.632723 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.632625    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a04cc886-ddc6-43df-b249-144b098d2ddf-kube-api-access-8f5k9" (OuterVolumeSpecName: "kube-api-access-8f5k9") pod "a04cc886-ddc6-43df-b249-144b098d2ddf" (UID: "a04cc886-ddc6-43df-b249-144b098d2ddf"). InnerVolumeSpecName "kube-api-access-8f5k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:18:37.706297 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.706267    2531 generic.go:356] "Generic (PLEG): container finished" podID="a04cc886-ddc6-43df-b249-144b098d2ddf" containerID="87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4" exitCode=0
Jul 29 20:18:37.706432 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.706312    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"
Jul 29 20:18:37.706432 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.706343    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4" event={"ID":"a04cc886-ddc6-43df-b249-144b098d2ddf","Type":"ContainerDied","Data":"87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4"}
Jul 29 20:18:37.706432 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.706372    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4" event={"ID":"a04cc886-ddc6-43df-b249-144b098d2ddf","Type":"ContainerDied","Data":"38f7d9520e19e21484508b91ed8bd6f2b7dbfd0fcb96bd8388b48934a0498d9d"}
Jul 29 20:18:37.706432 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.706388    2531 scope.go:117] "RemoveContainer" containerID="87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4"
Jul 29 20:18:37.715613 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.715597    2531 scope.go:117] "RemoveContainer" containerID="87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4"
Jul 29 20:18:37.715855 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:18:37.715836    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4\": container with ID starting with 87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4 not found: ID does not exist" containerID="87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4"
Jul 29 20:18:37.715905 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.715864    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4"} err="failed to get container status \"87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4\": rpc error: code = NotFound desc = could not find container \"87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4\": container with ID starting with 87b06ef73301870cfaeaadc887523daba3cbca4dd43dc3300a5affb6b655dfc4 not found: ID does not exist"
Jul 29 20:18:37.728455 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.728386    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"]
Jul 29 20:18:37.730846 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.730816    2531 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a04cc886-ddc6-43df-b249-144b098d2ddf-tls-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:18:37.730846 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.730845    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f5k9\" (UniqueName: \"kubernetes.io/projected/a04cc886-ddc6-43df-b249-144b098d2ddf-kube-api-access-8f5k9\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:18:37.731009 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.730860    2531 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-tmp-dir\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:18:37.731009 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.730872    2531 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-dshm\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:18:37.731009 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.730884    2531 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a04cc886-ddc6-43df-b249-144b098d2ddf-home\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:18:37.732877 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:37.732858    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/auth-test-model-1a1eaa-kserve-54b5989ddc-84ch4"]
Jul 29 20:18:38.371372 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:38.371333    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a04cc886-ddc6-43df-b249-144b098d2ddf" path="/var/lib/kubelet/pods/a04cc886-ddc6-43df-b249-144b098d2ddf/volumes"
Jul 29 20:18:47.167599 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.167564    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"]
Jul 29 20:18:47.167994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.167896    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a04cc886-ddc6-43df-b249-144b098d2ddf" containerName="main"
Jul 29 20:18:47.167994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.167907    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="a04cc886-ddc6-43df-b249-144b098d2ddf" containerName="main"
Jul 29 20:18:47.167994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.167964    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="a04cc886-ddc6-43df-b249-144b098d2ddf" containerName="main"
Jul 29 20:18:47.172294 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.172277    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.175993 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.175968    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"kube-root-ca.crt\""
Jul 29 20:18:47.176159 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.176001    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"openshift-service-ca.crt\""
Jul 29 20:18:47.176159 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.176008    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"sub-test-model-1a1eaa-kserve-self-signed-certs\""
Jul 29 20:18:47.176159 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.176017    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"default-dockercfg-x7glc\""
Jul 29 20:18:47.181283 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.181262    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"]
Jul 29 20:18:47.213914 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.213881    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-tmp-dir\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.214142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.213926    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-model-cache\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.214142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.213966    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-dshm\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.214142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.214012    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f977b557-2dde-412f-80fa-d2bb64247415-tls-certs\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.214142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.214036    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-home\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.214142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.214089    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7z8t\" (UniqueName: \"kubernetes.io/projected/f977b557-2dde-412f-80fa-d2bb64247415-kube-api-access-b7z8t\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.314703 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.314663    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-tmp-dir\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.314906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.314716    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-model-cache\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.314906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.314757    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-dshm\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.314906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.314800    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f977b557-2dde-412f-80fa-d2bb64247415-tls-certs\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.314906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.314830    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-home\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.314906 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.314855    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7z8t\" (UniqueName: \"kubernetes.io/projected/f977b557-2dde-412f-80fa-d2bb64247415-kube-api-access-b7z8t\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.315202 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.315107    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-tmp-dir\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.315202 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.315153    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-model-cache\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.315294 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.315226    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-home\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.317193 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.317174    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-dshm\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.317442 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.317423    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f977b557-2dde-412f-80fa-d2bb64247415-tls-certs\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.326520 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.326498    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7z8t\" (UniqueName: \"kubernetes.io/projected/f977b557-2dde-412f-80fa-d2bb64247415-kube-api-access-b7z8t\") pod \"sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") " pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.482283 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.482235    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:47.617857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.617832    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"]
Jul 29 20:18:47.619816 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:18:47.619785    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf977b557_2dde_412f_80fa_d2bb64247415.slice/crio-a99c8fdb00bb307a0c2d4f39d25d49124f7e72c2b3f155c4f19eb98f20a1c1e4 WatchSource:0}: Error finding container a99c8fdb00bb307a0c2d4f39d25d49124f7e72c2b3f155c4f19eb98f20a1c1e4: Status 404 returned error can't find the container with id a99c8fdb00bb307a0c2d4f39d25d49124f7e72c2b3f155c4f19eb98f20a1c1e4
Jul 29 20:18:47.755644 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.755560    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm" event={"ID":"f977b557-2dde-412f-80fa-d2bb64247415","Type":"ContainerStarted","Data":"8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd"}
Jul 29 20:18:47.755644 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.755601    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm" event={"ID":"f977b557-2dde-412f-80fa-d2bb64247415","Type":"ContainerStarted","Data":"a99c8fdb00bb307a0c2d4f39d25d49124f7e72c2b3f155c4f19eb98f20a1c1e4"}
Jul 29 20:18:47.772669 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:47.772617    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm" podStartSLOduration=0.772603077 podStartE2EDuration="772.603077ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:18:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:18:47.772567784 +0000 UTC m=+2935.926826403" watchObservedRunningTime="2026-07-29 20:18:47.772603077 +0000 UTC m=+2935.926861696"
Jul 29 20:18:52.646946 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:52.646911    2531 scope.go:117] "RemoveContainer" containerID="51ce7a2f2b304dd6ac50343b28e14b186b22d71b8906a1db502b6a01843891e7"
Jul 29 20:18:57.482943 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:57.482895    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:57.482943 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:57.482953    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:57.495474 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:57.495446    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:18:57.813989 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:18:57.813906    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:19:46.183352 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:19:46.183320    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"]
Jul 29 20:20:01.202298 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.202249    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm" podUID="f977b557-2dde-412f-80fa-d2bb64247415" containerName="main" containerID="cri-o://8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd" gracePeriod=45
Jul 29 20:20:01.456632 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.456562    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:20:01.556472 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556432    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f977b557-2dde-412f-80fa-d2bb64247415-tls-certs\") pod \"f977b557-2dde-412f-80fa-d2bb64247415\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") "
Jul 29 20:20:01.556472 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556480    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-home\") pod \"f977b557-2dde-412f-80fa-d2bb64247415\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") "
Jul 29 20:20:01.556739 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556496    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7z8t\" (UniqueName: \"kubernetes.io/projected/f977b557-2dde-412f-80fa-d2bb64247415-kube-api-access-b7z8t\") pod \"f977b557-2dde-412f-80fa-d2bb64247415\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") "
Jul 29 20:20:01.556739 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556526    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-model-cache\") pod \"f977b557-2dde-412f-80fa-d2bb64247415\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") "
Jul 29 20:20:01.556739 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556546    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-tmp-dir\") pod \"f977b557-2dde-412f-80fa-d2bb64247415\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") "
Jul 29 20:20:01.556739 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556577    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-dshm\") pod \"f977b557-2dde-412f-80fa-d2bb64247415\" (UID: \"f977b557-2dde-412f-80fa-d2bb64247415\") "
Jul 29 20:20:01.556935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556796    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-home" (OuterVolumeSpecName: "home") pod "f977b557-2dde-412f-80fa-d2bb64247415" (UID: "f977b557-2dde-412f-80fa-d2bb64247415"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:20:01.556935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556864    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f977b557-2dde-412f-80fa-d2bb64247415" (UID: "f977b557-2dde-412f-80fa-d2bb64247415"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:20:01.556935 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.556876    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-model-cache" (OuterVolumeSpecName: "model-cache") pod "f977b557-2dde-412f-80fa-d2bb64247415" (UID: "f977b557-2dde-412f-80fa-d2bb64247415"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:20:01.558853 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.558822    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-dshm" (OuterVolumeSpecName: "dshm") pod "f977b557-2dde-412f-80fa-d2bb64247415" (UID: "f977b557-2dde-412f-80fa-d2bb64247415"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:20:01.558943 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.558876    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f977b557-2dde-412f-80fa-d2bb64247415-kube-api-access-b7z8t" (OuterVolumeSpecName: "kube-api-access-b7z8t") pod "f977b557-2dde-412f-80fa-d2bb64247415" (UID: "f977b557-2dde-412f-80fa-d2bb64247415"). InnerVolumeSpecName "kube-api-access-b7z8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:20:01.558943 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.558879    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f977b557-2dde-412f-80fa-d2bb64247415-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f977b557-2dde-412f-80fa-d2bb64247415" (UID: "f977b557-2dde-412f-80fa-d2bb64247415"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:20:01.658142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.658093    2531 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f977b557-2dde-412f-80fa-d2bb64247415-tls-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:20:01.658142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.658134    2531 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-home\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:20:01.658142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.658143    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7z8t\" (UniqueName: \"kubernetes.io/projected/f977b557-2dde-412f-80fa-d2bb64247415-kube-api-access-b7z8t\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:20:01.658142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.658154    2531 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-model-cache\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:20:01.658142 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.658163    2531 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-tmp-dir\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:20:01.658449 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:01.658169    2531 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f977b557-2dde-412f-80fa-d2bb64247415-dshm\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:20:02.115396 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.115356    2531 generic.go:356] "Generic (PLEG): container finished" podID="f977b557-2dde-412f-80fa-d2bb64247415" containerID="8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd" exitCode=0
Jul 29 20:20:02.115588 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.115408    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"
Jul 29 20:20:02.115588 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.115440    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm" event={"ID":"f977b557-2dde-412f-80fa-d2bb64247415","Type":"ContainerDied","Data":"8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd"}
Jul 29 20:20:02.115588 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.115486    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm" event={"ID":"f977b557-2dde-412f-80fa-d2bb64247415","Type":"ContainerDied","Data":"a99c8fdb00bb307a0c2d4f39d25d49124f7e72c2b3f155c4f19eb98f20a1c1e4"}
Jul 29 20:20:02.115588 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.115503    2531 scope.go:117] "RemoveContainer" containerID="8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd"
Jul 29 20:20:02.125073 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.125027    2531 scope.go:117] "RemoveContainer" containerID="8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd"
Jul 29 20:20:02.125301 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:20:02.125285    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd\": container with ID starting with 8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd not found: ID does not exist" containerID="8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd"
Jul 29 20:20:02.125354 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.125309    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd"} err="failed to get container status \"8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd\": rpc error: code = NotFound desc = could not find container \"8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd\": container with ID starting with 8f938425777cfb458282435bcfd9e5d67ee2b05f0d9645c04d963f706dda27cd not found: ID does not exist"
Jul 29 20:20:02.138592 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.138562    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"]
Jul 29 20:20:02.144756 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.144729    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/sub-test-model-1a1eaa-kserve-5cb456bbc5-ldkxm"]
Jul 29 20:20:02.372528 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:02.372446    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f977b557-2dde-412f-80fa-d2bb64247415" path="/var/lib/kubelet/pods/f977b557-2dde-412f-80fa-d2bb64247415/volumes"
Jul 29 20:20:20.885162 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.885130    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"]
Jul 29 20:20:20.885601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.885446    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f977b557-2dde-412f-80fa-d2bb64247415" containerName="main"
Jul 29 20:20:20.885601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.885457    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="f977b557-2dde-412f-80fa-d2bb64247415" containerName="main"
Jul 29 20:20:20.885601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.885526    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="f977b557-2dde-412f-80fa-d2bb64247415" containerName="main"
Jul 29 20:20:20.889879 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.889863    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:20.893907 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.893843    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"kube-root-ca.crt\""
Jul 29 20:20:20.893907 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.893882    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"rate-test-model-1a1eaa-kserve-self-signed-certs\""
Jul 29 20:20:20.893907 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.893851    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"default-dockercfg-x7glc\""
Jul 29 20:20:20.893907 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.893913    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a1eaa\"/\"openshift-service-ca.crt\""
Jul 29 20:20:20.897972 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:20.897948    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"]
Jul 29 20:20:21.020678 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.020643    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-model-cache\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.020851 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.020709    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-home\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.020851 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.020733    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tls-certs\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.020851 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.020753    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9ltp\" (UniqueName: \"kubernetes.io/projected/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-kube-api-access-t9ltp\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.020851 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.020776    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-dshm\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.020851 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.020809    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tmp-dir\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121366 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121333    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-model-cache\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121550 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121393    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-home\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121550 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121497    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tls-certs\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121550 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121543    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9ltp\" (UniqueName: \"kubernetes.io/projected/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-kube-api-access-t9ltp\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121662 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121580    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-dshm\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121662 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121612    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tmp-dir\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121768 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121748    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-home\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121829 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121805    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-model-cache\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.121961 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.121944    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tmp-dir\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.123867 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.123834    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-dshm\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.124183 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.124162    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tls-certs\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.130655 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.130632    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9ltp\" (UniqueName: \"kubernetes.io/projected/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-kube-api-access-t9ltp\") pod \"rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") " pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.200559 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.200527    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:21.341442 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:21.341418    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"]
Jul 29 20:20:21.343894 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:20:21.343861    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7dd26bd_ef6c_441a_8047_c3efd0dc4453.slice/crio-c46438d6d396e9f96b797827cb771c5fe712ee807ddffa757ff48d506e19c4c3 WatchSource:0}: Error finding container c46438d6d396e9f96b797827cb771c5fe712ee807ddffa757ff48d506e19c4c3: Status 404 returned error can't find the container with id c46438d6d396e9f96b797827cb771c5fe712ee807ddffa757ff48d506e19c4c3
Jul 29 20:20:22.217253 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:22.217207    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh" event={"ID":"e7dd26bd-ef6c-441a-8047-c3efd0dc4453","Type":"ContainerStarted","Data":"bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e"}
Jul 29 20:20:22.217649 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:22.217264    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh" event={"ID":"e7dd26bd-ef6c-441a-8047-c3efd0dc4453","Type":"ContainerStarted","Data":"c46438d6d396e9f96b797827cb771c5fe712ee807ddffa757ff48d506e19c4c3"}
Jul 29 20:20:22.238594 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:22.238532    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh" podStartSLOduration=2.238518078 podStartE2EDuration="2.238518078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:20:22.23713059 +0000 UTC m=+3030.391389209" watchObservedRunningTime="2026-07-29 20:20:22.238518078 +0000 UTC m=+3030.392776698"
Jul 29 20:20:31.201544 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:31.201504    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:31.201544 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:31.201550    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:31.213888 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:31.213864    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:20:31.279604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:20:31.279578    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:21:19.895848 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:19.895807    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"]
Jul 29 20:21:34.914498 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:34.914430    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh" podUID="e7dd26bd-ef6c-441a-8047-c3efd0dc4453" containerName="main" containerID="cri-o://bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e" gracePeriod=45
Jul 29 20:21:35.159673 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.159647    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:21:35.236379 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236345    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-home\") pod \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") "
Jul 29 20:21:35.236554 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236389    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-dshm\") pod \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") "
Jul 29 20:21:35.236554 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236430    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-model-cache\") pod \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") "
Jul 29 20:21:35.236554 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236459    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9ltp\" (UniqueName: \"kubernetes.io/projected/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-kube-api-access-t9ltp\") pod \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") "
Jul 29 20:21:35.236554 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236498    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tmp-dir\") pod \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") "
Jul 29 20:21:35.236554 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236533    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tls-certs\") pod \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\" (UID: \"e7dd26bd-ef6c-441a-8047-c3efd0dc4453\") "
Jul 29 20:21:35.236818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236665    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-home" (OuterVolumeSpecName: "home") pod "e7dd26bd-ef6c-441a-8047-c3efd0dc4453" (UID: "e7dd26bd-ef6c-441a-8047-c3efd0dc4453"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:21:35.236818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236745    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-model-cache" (OuterVolumeSpecName: "model-cache") pod "e7dd26bd-ef6c-441a-8047-c3efd0dc4453" (UID: "e7dd26bd-ef6c-441a-8047-c3efd0dc4453"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:21:35.236818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236766    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e7dd26bd-ef6c-441a-8047-c3efd0dc4453" (UID: "e7dd26bd-ef6c-441a-8047-c3efd0dc4453"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:21:35.236818 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.236811    2531 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-home\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:21:35.238855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.238825    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-dshm" (OuterVolumeSpecName: "dshm") pod "e7dd26bd-ef6c-441a-8047-c3efd0dc4453" (UID: "e7dd26bd-ef6c-441a-8047-c3efd0dc4453"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:21:35.238855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.238833    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-kube-api-access-t9ltp" (OuterVolumeSpecName: "kube-api-access-t9ltp") pod "e7dd26bd-ef6c-441a-8047-c3efd0dc4453" (UID: "e7dd26bd-ef6c-441a-8047-c3efd0dc4453"). InnerVolumeSpecName "kube-api-access-t9ltp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:21:35.239014 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.238846    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e7dd26bd-ef6c-441a-8047-c3efd0dc4453" (UID: "e7dd26bd-ef6c-441a-8047-c3efd0dc4453"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 20:21:35.338286 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.338247    2531 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tmp-dir\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:21:35.338286 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.338280    2531 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-tls-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:21:35.338286 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.338293    2531 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-dshm\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:21:35.338533 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.338303    2531 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-model-cache\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:21:35.338533 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.338314    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9ltp\" (UniqueName: \"kubernetes.io/projected/e7dd26bd-ef6c-441a-8047-c3efd0dc4453-kube-api-access-t9ltp\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:21:35.571849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.571756    2531 generic.go:356] "Generic (PLEG): container finished" podID="e7dd26bd-ef6c-441a-8047-c3efd0dc4453" containerID="bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e" exitCode=0
Jul 29 20:21:35.571849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.571795    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh" event={"ID":"e7dd26bd-ef6c-441a-8047-c3efd0dc4453","Type":"ContainerDied","Data":"bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e"}
Jul 29 20:21:35.571849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.571799    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"
Jul 29 20:21:35.571849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.571822    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh" event={"ID":"e7dd26bd-ef6c-441a-8047-c3efd0dc4453","Type":"ContainerDied","Data":"c46438d6d396e9f96b797827cb771c5fe712ee807ddffa757ff48d506e19c4c3"}
Jul 29 20:21:35.571849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.571840    2531 scope.go:117] "RemoveContainer" containerID="bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e"
Jul 29 20:21:35.581564 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.581548    2531 scope.go:117] "RemoveContainer" containerID="bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e"
Jul 29 20:21:35.581803 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:21:35.581786    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e\": container with ID starting with bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e not found: ID does not exist" containerID="bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e"
Jul 29 20:21:35.581847 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.581812    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e"} err="failed to get container status \"bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e\": rpc error: code = NotFound desc = could not find container \"bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e\": container with ID starting with bf49d53ac6264ee4ae2e1de14904cc77d20c433ade1d51f84aff385d464c500e not found: ID does not exist"
Jul 29 20:21:35.595368 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.595345    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"]
Jul 29 20:21:35.599432 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:35.599414    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1a1eaa/rate-test-model-1a1eaa-kserve-66669b65f5-d6mdh"]
Jul 29 20:21:36.371484 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:36.371451    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7dd26bd-ef6c-441a-8047-c3efd0dc4453" path="/var/lib/kubelet/pods/e7dd26bd-ef6c-441a-8047-c3efd0dc4453/volumes"
Jul 29 20:21:39.901637 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.901603    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"]
Jul 29 20:21:39.902137 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.902118    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7dd26bd-ef6c-441a-8047-c3efd0dc4453" containerName="main"
Jul 29 20:21:39.902215 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.902140    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7dd26bd-ef6c-441a-8047-c3efd0dc4453" containerName="main"
Jul 29 20:21:39.902259 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.902239    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7dd26bd-ef6c-441a-8047-c3efd0dc4453" containerName="main"
Jul 29 20:21:39.906793 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.906777    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.909319 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.909298    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-658cad-openshift-default-dockercfg-gf2j9\""
Jul 29 20:21:39.917583 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.917559    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"]
Jul 29 20:21:39.977974 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.977932    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16df888-d832-430c-bff6-9b2c2010b992-istiod-ca-cert\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978004    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfckw\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-kube-api-access-dfckw\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978038    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16df888-d832-430c-bff6-9b2c2010b992-istio-podinfo\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978121    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-credential-socket\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978321 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978179    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-socket\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978321 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978201    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-certs\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978321 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978258    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-data\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978321 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978279    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-istio-token\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:39.978469 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:39.978323    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-envoy\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079162 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079130    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-envoy\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079376 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079183    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16df888-d832-430c-bff6-9b2c2010b992-istiod-ca-cert\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079376 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079319    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfckw\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-kube-api-access-dfckw\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079376 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079370    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16df888-d832-430c-bff6-9b2c2010b992-istio-podinfo\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079558 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079405    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-credential-socket\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079558 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079458    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-socket\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079558 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079486    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-certs\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079558 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079545    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-data\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079754 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079571    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-istio-token\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079754 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079737    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-credential-socket\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079856 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079817    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-socket\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079939 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079916    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16df888-d832-430c-bff6-9b2c2010b992-istiod-ca-cert\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.079985 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.079919    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-certs\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.080039 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.080022    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-data\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.081614 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.081597    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-envoy\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.081974 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.081958    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16df888-d832-430c-bff6-9b2c2010b992-istio-podinfo\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.090872 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.090845    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-istio-token\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.091085 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.091047    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfckw\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-kube-api-access-dfckw\") pod \"e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") " pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.217547 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.217520    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:40.355550 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.355515    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"]
Jul 29 20:21:40.359123 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:21:40.359098    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16df888_d832_430c_bff6_9b2c2010b992.slice/crio-df31e35d36934d60167e8e660e17dbfe03b0964dd39f7ff6d5176c29de263f39 WatchSource:0}: Error finding container df31e35d36934d60167e8e660e17dbfe03b0964dd39f7ff6d5176c29de263f39: Status 404 returned error can't find the container with id df31e35d36934d60167e8e660e17dbfe03b0964dd39f7ff6d5176c29de263f39
Jul 29 20:21:40.361258 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.361224    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:21:40.361335 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.361294    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:21:40.361335 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.361321    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:21:40.599611 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.599510    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" event={"ID":"f16df888-d832-430c-bff6-9b2c2010b992","Type":"ContainerStarted","Data":"992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8"}
Jul 29 20:21:40.599611 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.599569    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" event={"ID":"f16df888-d832-430c-bff6-9b2c2010b992","Type":"ContainerStarted","Data":"df31e35d36934d60167e8e660e17dbfe03b0964dd39f7ff6d5176c29de263f39"}
Jul 29 20:21:40.624196 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:40.624150    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" podStartSLOduration=1.624134655 podStartE2EDuration="1.624134655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:21:40.622384221 +0000 UTC m=+3108.776642841" watchObservedRunningTime="2026-07-29 20:21:40.624134655 +0000 UTC m=+3108.778393274"
Jul 29 20:21:41.218770 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:41.218733    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:41.223527 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:41.223502    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:41.604173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:41.604091    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:41.605186 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:41.605163    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:21:43.485740 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.485699    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"]
Jul 29 20:21:43.489148 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.489131    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.491714 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.491684    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-658cad\""
Jul 29 20:21:43.491836 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.491784    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-658cad-dockercfg-njg7f\""
Jul 29 20:21:43.499216 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.499191    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"]
Jul 29 20:21:43.613531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.613499    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9641e8c4-362f-46a8-89e6-58258d01c221-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.613725 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.613544    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ptqt\" (UniqueName: \"kubernetes.io/projected/9641e8c4-362f-46a8-89e6-58258d01c221-kube-api-access-8ptqt\") pod \"payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.715079 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.715011    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9641e8c4-362f-46a8-89e6-58258d01c221-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.715284 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.715203    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ptqt\" (UniqueName: \"kubernetes.io/projected/9641e8c4-362f-46a8-89e6-58258d01c221-kube-api-access-8ptqt\") pod \"payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.715711 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.715692    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9641e8c4-362f-46a8-89e6-58258d01c221-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.724422 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.724388    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ptqt\" (UniqueName: \"kubernetes.io/projected/9641e8c4-362f-46a8-89e6-58258d01c221-kube-api-access-8ptqt\") pod \"payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.801140 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.801034    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:43.935232 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:43.935198    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"]
Jul 29 20:21:43.936526 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:21:43.936505    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9641e8c4_362f_46a8_89e6_58258d01c221.slice/crio-831545e04245322bda09d5e294ccfe085eb849038dd0c5df347f9b4bae6de569 WatchSource:0}: Error finding container 831545e04245322bda09d5e294ccfe085eb849038dd0c5df347f9b4bae6de569: Status 404 returned error can't find the container with id 831545e04245322bda09d5e294ccfe085eb849038dd0c5df347f9b4bae6de569
Jul 29 20:21:44.620850 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:44.620811    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm" event={"ID":"9641e8c4-362f-46a8-89e6-58258d01c221","Type":"ContainerStarted","Data":"2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390"}
Jul 29 20:21:44.621298 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:44.620868    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm" event={"ID":"9641e8c4-362f-46a8-89e6-58258d01c221","Type":"ContainerStarted","Data":"831545e04245322bda09d5e294ccfe085eb849038dd0c5df347f9b4bae6de569"}
Jul 29 20:21:44.621298 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:44.620888    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:44.642430 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:44.642386    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm" podStartSLOduration=1.642372009 podStartE2EDuration="1.642372009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:21:44.640026124 +0000 UTC m=+3112.794284746" watchObservedRunningTime="2026-07-29 20:21:44.642372009 +0000 UTC m=+3112.796630629"
Jul 29 20:21:55.628995 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:55.628958    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:21:57.646219 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:57.646174    2531 patch_prober.go:28] interesting pod/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 20:21:57.646630 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:57.646266    2531 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 20:21:58.697789 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:58.697753    2531 generic.go:356] "Generic (PLEG): container finished" podID="f16df888-d832-430c-bff6-9b2c2010b992" containerID="992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8" exitCode=0
Jul 29 20:21:58.698228 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:58.697828    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" event={"ID":"f16df888-d832-430c-bff6-9b2c2010b992","Type":"ContainerDied","Data":"992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8"}
Jul 29 20:21:58.698320 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:58.698302    2531 scope.go:117] "RemoveContainer" containerID="992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8"
Jul 29 20:21:58.699420 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:58.699390    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:21:58.699502 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:58.699475    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:21:58.699541 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:58.699512    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:21:59.705046 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:21:59.705014    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" event={"ID":"f16df888-d832-430c-bff6-9b2c2010b992","Type":"ContainerStarted","Data":"3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d"}
Jul 29 20:22:00.218396 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:00.218357    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:22:00.218641 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:00.218619    2531 patch_prober.go:28] interesting pod/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:22:00.218701 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:00.218680    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:22:01.218632 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:01.218596    2531 patch_prober.go:28] interesting pod/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:22:01.219020 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:01.218652    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:22:02.218287 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:02.218250    2531 patch_prober.go:28] interesting pod/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:22:02.218467 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:02.218309    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:22:03.218601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:03.218562    2531 patch_prober.go:28] interesting pod/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 29 20:22:03.219000 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:03.218637    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 29 20:22:04.222075 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:04.222032    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:22:04.222516 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:04.222394    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:22:04.223127 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:04.223111    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:22:08.412269 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.412232    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"]
Jul 29 20:22:08.414657 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.414635    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.417451 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.417429    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-259e5b-openshift-default-dockercfg-5hnhk\""
Jul 29 20:22:08.427116 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.427094    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"]
Jul 29 20:22:08.539890 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.539854    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-socket\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.539890 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.539888    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-certs\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.540174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.539918    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-credential-socket\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.540174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.539975    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-podinfo\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.540174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.540011    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-data\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.540174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.540030    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv68h\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-kube-api-access-wv68h\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.540174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.540117    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-token\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.540174 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.540153    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-envoy\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.540399 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.540184    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istiod-ca-cert\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640749 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640711    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-token\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640760    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-envoy\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640789    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istiod-ca-cert\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640809    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-socket\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640824    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-certs\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640859    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-credential-socket\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640882    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-podinfo\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640899    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-data\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.640928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.640916    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv68h\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-kube-api-access-wv68h\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.641401 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.641352    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-credential-socket\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.641463 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.641395    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-certs\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.641463 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.641444    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-data\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.641562 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.641497    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-socket\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.641719 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.641694    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istiod-ca-cert\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.643750 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.643727    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-envoy\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.643961 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.643942    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-podinfo\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.650258 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.650232    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-token\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.650367 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.650298    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv68h\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-kube-api-access-wv68h\") pod \"e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") " pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.724262 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.724231    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:08.864248 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.864222    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"]
Jul 29 20:22:08.865739 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:22:08.865714    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ceb61e_57e1_4a00_965d_d4b74f5730ee.slice/crio-fda6b2cfce0bb25db43655c7a8c01b2f91d1151082cbec580e587d981d79226b WatchSource:0}: Error finding container fda6b2cfce0bb25db43655c7a8c01b2f91d1151082cbec580e587d981d79226b: Status 404 returned error can't find the container with id fda6b2cfce0bb25db43655c7a8c01b2f91d1151082cbec580e587d981d79226b
Jul 29 20:22:08.867870 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.867836    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:22:08.867952 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.867903    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:22:08.867952 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:08.867937    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:22:09.758095 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:09.758026    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" event={"ID":"e8ceb61e-57e1-4a00-965d-d4b74f5730ee","Type":"ContainerStarted","Data":"dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773"}
Jul 29 20:22:09.758498 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:09.758103    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" event={"ID":"e8ceb61e-57e1-4a00-965d-d4b74f5730ee","Type":"ContainerStarted","Data":"fda6b2cfce0bb25db43655c7a8c01b2f91d1151082cbec580e587d981d79226b"}
Jul 29 20:22:09.781113 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:09.781044    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" podStartSLOduration=1.781028306 podStartE2EDuration="1.781028306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:22:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:22:09.77812744 +0000 UTC m=+3137.932386052" watchObservedRunningTime="2026-07-29 20:22:09.781028306 +0000 UTC m=+3137.935286924"
Jul 29 20:22:10.724410 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:10.724367    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:10.729284 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:10.729262    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:10.763285 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:10.763248    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:10.764154 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:10.764125    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:29.856590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:29.856553    2531 generic.go:356] "Generic (PLEG): container finished" podID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerID="dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773" exitCode=0
Jul 29 20:22:29.857023 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:29.856630    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" event={"ID":"e8ceb61e-57e1-4a00-965d-d4b74f5730ee","Type":"ContainerDied","Data":"dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773"}
Jul 29 20:22:29.857097 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:29.857024    2531 scope.go:117] "RemoveContainer" containerID="dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773"
Jul 29 20:22:29.858042 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:29.858016    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:22:29.858134 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:29.858106    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:22:29.858172 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:29.858138    2531 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 29 20:22:30.863518 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:30.863486    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" event={"ID":"e8ceb61e-57e1-4a00-965d-d4b74f5730ee","Type":"ContainerStarted","Data":"c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661"}
Jul 29 20:22:31.725254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:31.725210    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:31.725483 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:31.725459    2531 patch_prober.go:28] interesting pod/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 29 20:22:31.725542 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:31.725523    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 29 20:22:32.725387 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:32.725347    2531 patch_prober.go:28] interesting pod/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 29 20:22:32.725777 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:32.725407    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 29 20:22:33.724681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:33.724639    2531 patch_prober.go:28] interesting pod/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 29 20:22:33.724864 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:33.724705    2531 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 29 20:22:34.728017 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:34.727983    2531 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:34.728581 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:34.728391    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:22:34.728948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:22:34.728931    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:23:45.901148 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:45.901042    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm_9641e8c4-362f-46a8-89e6-58258d01c221/payload-processing/0.log"
Jul 29 20:23:50.408937 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.408903    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"]
Jul 29 20:23:50.412309 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.412288    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.415178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.415150    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-f4fc66\""
Jul 29 20:23:50.415178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.415164    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-f4fc66-dockercfg-mb9tf\""
Jul 29 20:23:50.423768 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.423740    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"]
Jul 29 20:23:50.441908 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.441878    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"]
Jul 29 20:23:50.445279 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.445198    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.456153 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.456127    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"]
Jul 29 20:23:50.558904 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.558860    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6n7\" (UniqueName: \"kubernetes.io/projected/42abc7f2-c504-4371-88d3-984800060956-kube-api-access-6k6n7\") pod \"payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.559126 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.558913    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whtks\" (UniqueName: \"kubernetes.io/projected/4cdd38a7-4f86-42b1-a090-07985e55190b-kube-api-access-whtks\") pod \"payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.559126 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.558969    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42abc7f2-c504-4371-88d3-984800060956-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.559247 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.559126    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdd38a7-4f86-42b1-a090-07985e55190b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.659677 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.659580    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdd38a7-4f86-42b1-a090-07985e55190b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.659677 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.659640    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6n7\" (UniqueName: \"kubernetes.io/projected/42abc7f2-c504-4371-88d3-984800060956-kube-api-access-6k6n7\") pod \"payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.659677 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.659658    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whtks\" (UniqueName: \"kubernetes.io/projected/4cdd38a7-4f86-42b1-a090-07985e55190b-kube-api-access-whtks\") pod \"payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.659677 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.659688    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42abc7f2-c504-4371-88d3-984800060956-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.660320 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.660302    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdd38a7-4f86-42b1-a090-07985e55190b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.660442 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.660415    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42abc7f2-c504-4371-88d3-984800060956-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.669338 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.669311    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6n7\" (UniqueName: \"kubernetes.io/projected/42abc7f2-c504-4371-88d3-984800060956-kube-api-access-6k6n7\") pod \"payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.669477 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.669457    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whtks\" (UniqueName: \"kubernetes.io/projected/4cdd38a7-4f86-42b1-a090-07985e55190b-kube-api-access-whtks\") pod \"payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.724433 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.724396    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:50.756590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.756561    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:50.876730 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.876698    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"]
Jul 29 20:23:50.878457 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:23:50.878411    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42abc7f2_c504_4371_88d3_984800060956.slice/crio-ffb0563ea8d3edd7a9de3956459ff979b7c6c85f2ebea888c615f59b15324bc4 WatchSource:0}: Error finding container ffb0563ea8d3edd7a9de3956459ff979b7c6c85f2ebea888c615f59b15324bc4: Status 404 returned error can't find the container with id ffb0563ea8d3edd7a9de3956459ff979b7c6c85f2ebea888c615f59b15324bc4
Jul 29 20:23:50.907994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:50.907969    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"]
Jul 29 20:23:50.911225 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:23:50.911198    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdd38a7_4f86_42b1_a090_07985e55190b.slice/crio-861fa84d154d3b38089719e0a1d7ddd831295b9021be95126029d3b82f6824a9 WatchSource:0}: Error finding container 861fa84d154d3b38089719e0a1d7ddd831295b9021be95126029d3b82f6824a9: Status 404 returned error can't find the container with id 861fa84d154d3b38089719e0a1d7ddd831295b9021be95126029d3b82f6824a9
Jul 29 20:23:51.255139 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.255104    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2" event={"ID":"42abc7f2-c504-4371-88d3-984800060956","Type":"ContainerStarted","Data":"d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c"}
Jul 29 20:23:51.255358 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.255170    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2" event={"ID":"42abc7f2-c504-4371-88d3-984800060956","Type":"ContainerStarted","Data":"ffb0563ea8d3edd7a9de3956459ff979b7c6c85f2ebea888c615f59b15324bc4"}
Jul 29 20:23:51.255358 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.255202    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:23:51.256680 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.256654    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j" event={"ID":"4cdd38a7-4f86-42b1-a090-07985e55190b","Type":"ContainerStarted","Data":"97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623"}
Jul 29 20:23:51.256781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.256701    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j" event={"ID":"4cdd38a7-4f86-42b1-a090-07985e55190b","Type":"ContainerStarted","Data":"861fa84d154d3b38089719e0a1d7ddd831295b9021be95126029d3b82f6824a9"}
Jul 29 20:23:51.256781 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.256722    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:23:51.272690 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.272640    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2" podStartSLOduration=1.272620646 podStartE2EDuration="1.272620646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:23:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:23:51.271639233 +0000 UTC m=+3239.425897854" watchObservedRunningTime="2026-07-29 20:23:51.272620646 +0000 UTC m=+3239.426879271"
Jul 29 20:23:51.290576 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:23:51.290529    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j" podStartSLOduration=1.290514023 podStartE2EDuration="1.290514023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:23:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:23:51.287903349 +0000 UTC m=+3239.442161970" watchObservedRunningTime="2026-07-29 20:23:51.290514023 +0000 UTC m=+3239.444772642"
Jul 29 20:24:02.264722 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:02.264691    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:24:02.265183 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:02.264859    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:24:20.461925 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.461875    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"]
Jul 29 20:24:20.462541 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.462190    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j" podUID="4cdd38a7-4f86-42b1-a090-07985e55190b" containerName="payload-processing" containerID="cri-o://97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623" gracePeriod=30
Jul 29 20:24:20.469393 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.469353    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"]
Jul 29 20:24:20.469693 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.469586    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2" podUID="42abc7f2-c504-4371-88d3-984800060956" containerName="payload-pre-processing" containerID="cri-o://d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c" gracePeriod=30
Jul 29 20:24:20.745334 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.745302    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:24:20.775980 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.775954    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:24:20.837287 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.837251    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k6n7\" (UniqueName: \"kubernetes.io/projected/42abc7f2-c504-4371-88d3-984800060956-kube-api-access-6k6n7\") pod \"42abc7f2-c504-4371-88d3-984800060956\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") "
Jul 29 20:24:20.837493 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.837304    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42abc7f2-c504-4371-88d3-984800060956-plugins-config-volume\") pod \"42abc7f2-c504-4371-88d3-984800060956\" (UID: \"42abc7f2-c504-4371-88d3-984800060956\") "
Jul 29 20:24:20.837493 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.837329    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whtks\" (UniqueName: \"kubernetes.io/projected/4cdd38a7-4f86-42b1-a090-07985e55190b-kube-api-access-whtks\") pod \"4cdd38a7-4f86-42b1-a090-07985e55190b\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") "
Jul 29 20:24:20.837493 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.837450    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdd38a7-4f86-42b1-a090-07985e55190b-plugins-config-volume\") pod \"4cdd38a7-4f86-42b1-a090-07985e55190b\" (UID: \"4cdd38a7-4f86-42b1-a090-07985e55190b\") "
Jul 29 20:24:20.837731 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.837709    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42abc7f2-c504-4371-88d3-984800060956-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42abc7f2-c504-4371-88d3-984800060956" (UID: "42abc7f2-c504-4371-88d3-984800060956"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:24:20.837799 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.837779    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cdd38a7-4f86-42b1-a090-07985e55190b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4cdd38a7-4f86-42b1-a090-07985e55190b" (UID: "4cdd38a7-4f86-42b1-a090-07985e55190b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:24:20.837799 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.837791    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42abc7f2-c504-4371-88d3-984800060956-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:24:20.839633 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.839601    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42abc7f2-c504-4371-88d3-984800060956-kube-api-access-6k6n7" (OuterVolumeSpecName: "kube-api-access-6k6n7") pod "42abc7f2-c504-4371-88d3-984800060956" (UID: "42abc7f2-c504-4371-88d3-984800060956"). InnerVolumeSpecName "kube-api-access-6k6n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:24:20.839751 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.839676    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cdd38a7-4f86-42b1-a090-07985e55190b-kube-api-access-whtks" (OuterVolumeSpecName: "kube-api-access-whtks") pod "4cdd38a7-4f86-42b1-a090-07985e55190b" (UID: "4cdd38a7-4f86-42b1-a090-07985e55190b"). InnerVolumeSpecName "kube-api-access-whtks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:24:20.938571 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.938518    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k6n7\" (UniqueName: \"kubernetes.io/projected/42abc7f2-c504-4371-88d3-984800060956-kube-api-access-6k6n7\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:24:20.938571 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.938563    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whtks\" (UniqueName: \"kubernetes.io/projected/4cdd38a7-4f86-42b1-a090-07985e55190b-kube-api-access-whtks\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:24:20.938571 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:20.938573    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdd38a7-4f86-42b1-a090-07985e55190b-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:24:21.414485 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.414450    2531 generic.go:356] "Generic (PLEG): container finished" podID="4cdd38a7-4f86-42b1-a090-07985e55190b" containerID="97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623" exitCode=0
Jul 29 20:24:21.414485 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.414490    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"
Jul 29 20:24:21.414741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.414534    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j" event={"ID":"4cdd38a7-4f86-42b1-a090-07985e55190b","Type":"ContainerDied","Data":"97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623"}
Jul 29 20:24:21.414741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.414585    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j" event={"ID":"4cdd38a7-4f86-42b1-a090-07985e55190b","Type":"ContainerDied","Data":"861fa84d154d3b38089719e0a1d7ddd831295b9021be95126029d3b82f6824a9"}
Jul 29 20:24:21.414741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.414609    2531 scope.go:117] "RemoveContainer" containerID="97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623"
Jul 29 20:24:21.418955 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.418899    2531 generic.go:356] "Generic (PLEG): container finished" podID="42abc7f2-c504-4371-88d3-984800060956" containerID="d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c" exitCode=0
Jul 29 20:24:21.419107 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.418958    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2" event={"ID":"42abc7f2-c504-4371-88d3-984800060956","Type":"ContainerDied","Data":"d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c"}
Jul 29 20:24:21.419107 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.419002    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2" event={"ID":"42abc7f2-c504-4371-88d3-984800060956","Type":"ContainerDied","Data":"ffb0563ea8d3edd7a9de3956459ff979b7c6c85f2ebea888c615f59b15324bc4"}
Jul 29 20:24:21.419107 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.419004    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"
Jul 29 20:24:21.428403 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.428382    2531 scope.go:117] "RemoveContainer" containerID="97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623"
Jul 29 20:24:21.428692 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:24:21.428672    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623\": container with ID starting with 97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623 not found: ID does not exist" containerID="97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623"
Jul 29 20:24:21.428751 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.428701    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623"} err="failed to get container status \"97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623\": rpc error: code = NotFound desc = could not find container \"97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623\": container with ID starting with 97656898ba1c2e1e49ef9ab4d1eab15664117f400d9350f1a36ac5ffd69a7623 not found: ID does not exist"
Jul 29 20:24:21.428751 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.428718    2531 scope.go:117] "RemoveContainer" containerID="d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c"
Jul 29 20:24:21.437307 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.437277    2531 scope.go:117] "RemoveContainer" containerID="d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c"
Jul 29 20:24:21.437679 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:24:21.437639    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c\": container with ID starting with d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c not found: ID does not exist" containerID="d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c"
Jul 29 20:24:21.437773 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.437678    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c"} err="failed to get container status \"d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c\": rpc error: code = NotFound desc = could not find container \"d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c\": container with ID starting with d568710c8c7ad382e50da0caa0bd0ce2a5063eb2716497ee6b90a516a333d37c not found: ID does not exist"
Jul 29 20:24:21.439797 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.439778    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"]
Jul 29 20:24:21.446839 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.446818    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-f4fc66-6848c75bb6-gxb7j"]
Jul 29 20:24:21.459182 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.459160    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"]
Jul 29 20:24:21.465829 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:21.465807    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f4fc66-5d48b94488-k5pk2"]
Jul 29 20:24:22.373517 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:22.373483    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42abc7f2-c504-4371-88d3-984800060956" path="/var/lib/kubelet/pods/42abc7f2-c504-4371-88d3-984800060956/volumes"
Jul 29 20:24:22.373842 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:22.373829    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cdd38a7-4f86-42b1-a090-07985e55190b" path="/var/lib/kubelet/pods/4cdd38a7-4f86-42b1-a090-07985e55190b/volumes"
Jul 29 20:24:46.433129 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.433089    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"]
Jul 29 20:24:46.433664 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.433350    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm" podUID="9641e8c4-362f-46a8-89e6-58258d01c221" containerName="payload-processing" containerID="cri-o://2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390" gracePeriod=30
Jul 29 20:24:46.695245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.695223    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:24:46.775177 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.775146    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9641e8c4-362f-46a8-89e6-58258d01c221-plugins-config-volume\") pod \"9641e8c4-362f-46a8-89e6-58258d01c221\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") "
Jul 29 20:24:46.775362 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.775206    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ptqt\" (UniqueName: \"kubernetes.io/projected/9641e8c4-362f-46a8-89e6-58258d01c221-kube-api-access-8ptqt\") pod \"9641e8c4-362f-46a8-89e6-58258d01c221\" (UID: \"9641e8c4-362f-46a8-89e6-58258d01c221\") "
Jul 29 20:24:46.775535 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.775511    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9641e8c4-362f-46a8-89e6-58258d01c221-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9641e8c4-362f-46a8-89e6-58258d01c221" (UID: "9641e8c4-362f-46a8-89e6-58258d01c221"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:24:46.777433 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.777408    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9641e8c4-362f-46a8-89e6-58258d01c221-kube-api-access-8ptqt" (OuterVolumeSpecName: "kube-api-access-8ptqt") pod "9641e8c4-362f-46a8-89e6-58258d01c221" (UID: "9641e8c4-362f-46a8-89e6-58258d01c221"). InnerVolumeSpecName "kube-api-access-8ptqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:24:46.876031 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.876000    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9641e8c4-362f-46a8-89e6-58258d01c221-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:24:46.876031 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:46.876027    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ptqt\" (UniqueName: \"kubernetes.io/projected/9641e8c4-362f-46a8-89e6-58258d01c221-kube-api-access-8ptqt\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:24:47.550320 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.550282    2531 generic.go:356] "Generic (PLEG): container finished" podID="9641e8c4-362f-46a8-89e6-58258d01c221" containerID="2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390" exitCode=0
Jul 29 20:24:47.550745 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.550331    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm" event={"ID":"9641e8c4-362f-46a8-89e6-58258d01c221","Type":"ContainerDied","Data":"2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390"}
Jul 29 20:24:47.550745 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.550371    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm" event={"ID":"9641e8c4-362f-46a8-89e6-58258d01c221","Type":"ContainerDied","Data":"831545e04245322bda09d5e294ccfe085eb849038dd0c5df347f9b4bae6de569"}
Jul 29 20:24:47.550745 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.550391    2531 scope.go:117] "RemoveContainer" containerID="2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390"
Jul 29 20:24:47.550745 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.550332    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"
Jul 29 20:24:47.559590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.559570    2531 scope.go:117] "RemoveContainer" containerID="2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390"
Jul 29 20:24:47.559848 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:24:47.559828    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390\": container with ID starting with 2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390 not found: ID does not exist" containerID="2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390"
Jul 29 20:24:47.559897 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.559861    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390"} err="failed to get container status \"2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390\": rpc error: code = NotFound desc = could not find container \"2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390\": container with ID starting with 2abecd72bc616373c7e4bd9d0512a4e41b9cf0081de12b6c0f791a0f9e156390 not found: ID does not exist"
Jul 29 20:24:47.575271 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.575248    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"]
Jul 29 20:24:47.579448 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:47.579427    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-658cad-64b97d684-csrgm"]
Jul 29 20:24:48.372448 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:24:48.372408    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9641e8c4-362f-46a8-89e6-58258d01c221" path="/var/lib/kubelet/pods/9641e8c4-362f-46a8-89e6-58258d01c221/volumes"
Jul 29 20:25:49.881418 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:49.881387    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"]
Jul 29 20:25:49.881883 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:49.881597    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy" containerID="cri-o://3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d" gracePeriod=30
Jul 29 20:25:55.140738 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.140676    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:25:55.294950 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.294908    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-istio-token\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.294957    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-data\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.294983    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16df888-d832-430c-bff6-9b2c2010b992-istio-podinfo\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295009    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16df888-d832-430c-bff6-9b2c2010b992-istiod-ca-cert\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295040    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfckw\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-kube-api-access-dfckw\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295087    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-credential-socket\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295120    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-socket\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295140    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-envoy\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295173 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295173    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-certs\") pod \"f16df888-d832-430c-bff6-9b2c2010b992\" (UID: \"f16df888-d832-430c-bff6-9b2c2010b992\") "
Jul 29 20:25:55.295738 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295692    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:25:55.295886 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295730    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16df888-d832-430c-bff6-9b2c2010b992-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:25:55.295975 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295945    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:25:55.296036 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.295987    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:25:55.296244 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.296223    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-data" (OuterVolumeSpecName: "istio-data") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:25:55.298157 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.298129    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f16df888-d832-430c-bff6-9b2c2010b992-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:25:55.298718 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.298678    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-kube-api-access-dfckw" (OuterVolumeSpecName: "kube-api-access-dfckw") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "kube-api-access-dfckw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:25:55.298847 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.298751    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:25:55.298847 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.298800    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-istio-token" (OuterVolumeSpecName: "istio-token") pod "f16df888-d832-430c-bff6-9b2c2010b992" (UID: "f16df888-d832-430c-bff6-9b2c2010b992"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396761    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396787    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396797    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396808    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396816    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396823    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f16df888-d832-430c-bff6-9b2c2010b992-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396830    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f16df888-d832-430c-bff6-9b2c2010b992-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396839    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f16df888-d832-430c-bff6-9b2c2010b992-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.396845 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.396846    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfckw\" (UniqueName: \"kubernetes.io/projected/f16df888-d832-430c-bff6-9b2c2010b992-kube-api-access-dfckw\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:25:55.891546 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.891507    2531 generic.go:356] "Generic (PLEG): container finished" podID="f16df888-d832-430c-bff6-9b2c2010b992" containerID="3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d" exitCode=0
Jul 29 20:25:55.891741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.891569    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"
Jul 29 20:25:55.891741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.891595    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" event={"ID":"f16df888-d832-430c-bff6-9b2c2010b992","Type":"ContainerDied","Data":"3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d"}
Jul 29 20:25:55.891741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.891671    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q" event={"ID":"f16df888-d832-430c-bff6-9b2c2010b992","Type":"ContainerDied","Data":"df31e35d36934d60167e8e660e17dbfe03b0964dd39f7ff6d5176c29de263f39"}
Jul 29 20:25:55.891741 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.891695    2531 scope.go:117] "RemoveContainer" containerID="3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d"
Jul 29 20:25:55.901276 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.901263    2531 scope.go:117] "RemoveContainer" containerID="992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8"
Jul 29 20:25:55.908844 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.908827    2531 scope.go:117] "RemoveContainer" containerID="3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d"
Jul 29 20:25:55.909105 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:25:55.909085    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d\": container with ID starting with 3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d not found: ID does not exist" containerID="3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d"
Jul 29 20:25:55.909188 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.909118    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d"} err="failed to get container status \"3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d\": rpc error: code = NotFound desc = could not find container \"3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d\": container with ID starting with 3f5b6f6d38ebce6fd913761129cb018bf552d390dbab1141ea4068c39c004d0d not found: ID does not exist"
Jul 29 20:25:55.909188 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.909142    2531 scope.go:117] "RemoveContainer" containerID="992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8"
Jul 29 20:25:55.909388 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:25:55.909372    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8\": container with ID starting with 992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8 not found: ID does not exist" containerID="992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8"
Jul 29 20:25:55.909429 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.909394    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8"} err="failed to get container status \"992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8\": rpc error: code = NotFound desc = could not find container \"992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8\": container with ID starting with 992a65603f694dc32de05a12783d0f5c064e1121a2909c59711c15549664abf8 not found: ID does not exist"
Jul 29 20:25:55.916216 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.916194    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"]
Jul 29 20:25:55.922538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:55.922518    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-658cad-openshift-default-568f77c944-r7v4q"]
Jul 29 20:25:56.372437 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:25:56.372393    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f16df888-d832-430c-bff6-9b2c2010b992" path="/var/lib/kubelet/pods/f16df888-d832-430c-bff6-9b2c2010b992/volumes"
Jul 29 20:26:08.074601 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:08.074565    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"]
Jul 29 20:26:08.075238 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:08.074759    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy" containerID="cri-o://c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661" gracePeriod=30
Jul 29 20:26:13.321229 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.321202    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:26:13.362379 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362306    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-credential-socket\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362379 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362366    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-socket\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362391    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-token\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362438    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-certs\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362477    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-data\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362520    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv68h\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-kube-api-access-wv68h\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362552    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-podinfo\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362590 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362579    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-envoy\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362872 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362600    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:13.362872 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362604    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istiod-ca-cert\") pod \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\" (UID: \"e8ceb61e-57e1-4a00-965d-d4b74f5730ee\") "
Jul 29 20:26:13.362872 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362755    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:13.362872 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362754    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:13.363036 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.362907    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:26:13.363531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.363317    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.363531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.363347    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.363531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.363361    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.363531 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.363377    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.363823 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.363534    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:13.364909 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.364881    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:26:13.365021 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.364916    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:26:13.365146 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.365038    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-kube-api-access-wv68h" (OuterVolumeSpecName: "kube-api-access-wv68h") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "kube-api-access-wv68h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:26:13.365355 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.365340    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8ceb61e-57e1-4a00-965d-d4b74f5730ee" (UID: "e8ceb61e-57e1-4a00-965d-d4b74f5730ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:13.464806 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.464765    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv68h\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-kube-api-access-wv68h\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.464806 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.464799    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.464806 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.464811    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.464806 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.464819    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.465175 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.464831    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8ceb61e-57e1-4a00-965d-d4b74f5730ee-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:13.980721 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.980688    2531 generic.go:356] "Generic (PLEG): container finished" podID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerID="c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661" exitCode=0
Jul 29 20:26:13.980891 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.980727    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" event={"ID":"e8ceb61e-57e1-4a00-965d-d4b74f5730ee","Type":"ContainerDied","Data":"c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661"}
Jul 29 20:26:13.980891 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.980738    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"
Jul 29 20:26:13.980891 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.980769    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c" event={"ID":"e8ceb61e-57e1-4a00-965d-d4b74f5730ee","Type":"ContainerDied","Data":"fda6b2cfce0bb25db43655c7a8c01b2f91d1151082cbec580e587d981d79226b"}
Jul 29 20:26:13.980891 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.980791    2531 scope.go:117] "RemoveContainer" containerID="c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661"
Jul 29 20:26:13.990232 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.990217    2531 scope.go:117] "RemoveContainer" containerID="dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773"
Jul 29 20:26:13.998155 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.998130    2531 scope.go:117] "RemoveContainer" containerID="c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661"
Jul 29 20:26:13.998396 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:26:13.998378    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661\": container with ID starting with c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661 not found: ID does not exist" containerID="c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661"
Jul 29 20:26:13.998446 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.998406    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661"} err="failed to get container status \"c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661\": rpc error: code = NotFound desc = could not find container \"c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661\": container with ID starting with c87e5c6ec62e396c9c45c0a76a9e59ca46f8a5c78ab7dd42eaaff32a99679661 not found: ID does not exist"
Jul 29 20:26:13.998446 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.998424    2531 scope.go:117] "RemoveContainer" containerID="dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773"
Jul 29 20:26:13.998651 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:26:13.998636    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773\": container with ID starting with dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773 not found: ID does not exist" containerID="dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773"
Jul 29 20:26:13.998693 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:13.998655    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773"} err="failed to get container status \"dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773\": rpc error: code = NotFound desc = could not find container \"dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773\": container with ID starting with dd8ce6c2d58f75b62a055043211beb4e775b9294b7b6180166bb270119fb5773 not found: ID does not exist"
Jul 29 20:26:14.004035 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:14.004011    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"]
Jul 29 20:26:14.007832 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:14.007811    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-259e5b-openshift-default-6c5874bbd4-stl5c"]
Jul 29 20:26:14.372216 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:14.372134    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" path="/var/lib/kubelet/pods/e8ceb61e-57e1-4a00-965d-d4b74f5730ee/volumes"
Jul 29 20:26:26.163561 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.163527    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"]
Jul 29 20:26:26.164101 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.163793    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy" containerID="cri-o://aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74" gracePeriod=30
Jul 29 20:26:26.514046 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514012    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"]
Jul 29 20:26:26.514337 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514324    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy"
Jul 29 20:26:26.514382 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514339    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy"
Jul 29 20:26:26.514382 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514348    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9641e8c4-362f-46a8-89e6-58258d01c221" containerName="payload-processing"
Jul 29 20:26:26.514382 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514354    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="9641e8c4-362f-46a8-89e6-58258d01c221" containerName="payload-processing"
Jul 29 20:26:26.514382 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514369    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy"
Jul 29 20:26:26.514382 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514375    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514387    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514393    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514399    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42abc7f2-c504-4371-88d3-984800060956" containerName="payload-pre-processing"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514405    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="42abc7f2-c504-4371-88d3-984800060956" containerName="payload-pre-processing"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514413    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cdd38a7-4f86-42b1-a090-07985e55190b" containerName="payload-processing"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514418    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cdd38a7-4f86-42b1-a090-07985e55190b" containerName="payload-processing"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514476    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514486    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="9641e8c4-362f-46a8-89e6-58258d01c221" containerName="payload-processing"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514496    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514505    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514513    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="42abc7f2-c504-4371-88d3-984800060956" containerName="payload-pre-processing"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514521    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cdd38a7-4f86-42b1-a090-07985e55190b" containerName="payload-processing"
Jul 29 20:26:26.514540 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.514530    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16df888-d832-430c-bff6-9b2c2010b992" containerName="istio-proxy"
Jul 29 20:26:26.518836 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.518817    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"
Jul 29 20:26:26.521207 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.521188    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 20:26:26.521276 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.521191    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vt6mz\""
Jul 29 20:26:26.525912 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.525891    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"]
Jul 29 20:26:26.572681 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.572655    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/111e9611-0785-418a-8f47-04474c5193b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6\" (UID: \"111e9611-0785-418a-8f47-04474c5193b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"
Jul 29 20:26:26.674125 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.674097    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/111e9611-0785-418a-8f47-04474c5193b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6\" (UID: \"111e9611-0785-418a-8f47-04474c5193b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"
Jul 29 20:26:26.674666 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.674649    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/111e9611-0785-418a-8f47-04474c5193b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6\" (UID: \"111e9611-0785-418a-8f47-04474c5193b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"
Jul 29 20:26:26.830889 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.830795    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"
Jul 29 20:26:26.962356 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:26.962331    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"]
Jul 29 20:26:26.964185 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:26:26.964156    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111e9611_0785_418a_8f47_04474c5193b9.slice/crio-c77b2c85d7253cd013956869b29065dc0028ba07036b73fbc0fe7507d3e87926 WatchSource:0}: Error finding container c77b2c85d7253cd013956869b29065dc0028ba07036b73fbc0fe7507d3e87926: Status 404 returned error can't find the container with id c77b2c85d7253cd013956869b29065dc0028ba07036b73fbc0fe7507d3e87926
Jul 29 20:26:27.047115 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:27.047048    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6" event={"ID":"111e9611-0785-418a-8f47-04474c5193b9","Type":"ContainerStarted","Data":"c77b2c85d7253cd013956869b29065dc0028ba07036b73fbc0fe7507d3e87926"}
Jul 29 20:26:28.053734 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:28.053697    2531 generic.go:356] "Generic (PLEG): container finished" podID="111e9611-0785-418a-8f47-04474c5193b9" containerID="54f05b9525eb89e02cf59d3a4eb041007d8ccca89810d8eb20f9f7ea62ab3d90" exitCode=0
Jul 29 20:26:28.054194 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:28.053764    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6" event={"ID":"111e9611-0785-418a-8f47-04474c5193b9","Type":"ContainerDied","Data":"54f05b9525eb89e02cf59d3a4eb041007d8ccca89810d8eb20f9f7ea62ab3d90"}
Jul 29 20:26:29.186886 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:29.186862    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"
Jul 29 20:26:29.297621 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:29.297580    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/111e9611-0785-418a-8f47-04474c5193b9-maas-api-service-ca\") pod \"111e9611-0785-418a-8f47-04474c5193b9\" (UID: \"111e9611-0785-418a-8f47-04474c5193b9\") "
Jul 29 20:26:29.297961 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:29.297938    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/111e9611-0785-418a-8f47-04474c5193b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "111e9611-0785-418a-8f47-04474c5193b9" (UID: "111e9611-0785-418a-8f47-04474c5193b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:26:29.398732 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:29.398635    2531 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/111e9611-0785-418a-8f47-04474c5193b9-maas-api-service-ca\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:30.065483 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:30.065444    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6" event={"ID":"111e9611-0785-418a-8f47-04474c5193b9","Type":"ContainerDied","Data":"c77b2c85d7253cd013956869b29065dc0028ba07036b73fbc0fe7507d3e87926"}
Jul 29 20:26:30.065657 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:30.065503    2531 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c77b2c85d7253cd013956869b29065dc0028ba07036b73fbc0fe7507d3e87926"
Jul 29 20:26:30.065657 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:30.065464    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"
Jul 29 20:26:31.417350 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.417328    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:26:31.516386 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516352    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-credential-socket\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516386 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516386    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-data\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516646 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516422    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istiod-ca-cert\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516646 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516441    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-podinfo\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516646 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516466    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lqrw\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-kube-api-access-6lqrw\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516646 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516581    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-envoy\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516646 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516632    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-socket\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516896 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516663    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:31.516896 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516683    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-certs\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.516896 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516713    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-token\") pod \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\" (UID: \"68f9c10b-20c5-4258-ad31-4d2b2e09365c\") "
Jul 29 20:26:31.517092 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516896    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:31.517092 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.516904    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:31.517092 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.517014    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.517092 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.517030    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.517092 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.517039    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.517496 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.517097    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:26:31.517665 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.517637    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-data" (OuterVolumeSpecName: "istio-data") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:31.518918 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.518892    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:26:31.519035 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.518960    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:31.519035 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.518988    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-kube-api-access-6lqrw" (OuterVolumeSpecName: "kube-api-access-6lqrw") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "kube-api-access-6lqrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:26:31.519346 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.519070    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-token" (OuterVolumeSpecName: "istio-token") pod "68f9c10b-20c5-4258-ad31-4d2b2e09365c" (UID: "68f9c10b-20c5-4258-ad31-4d2b2e09365c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:26:31.618388 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.618360    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.618388 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.618384    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.618388 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.618393    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.618604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.618401    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lqrw\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-kube-api-access-6lqrw\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.618604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.618409    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:31.618604 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:31.618417    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f9c10b-20c5-4258-ad31-4d2b2e09365c-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:32.077737 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.077700    2531 generic.go:356] "Generic (PLEG): container finished" podID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerID="aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74" exitCode=0
Jul 29 20:26:32.077912 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.077746    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"
Jul 29 20:26:32.077912 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.077784    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" event={"ID":"68f9c10b-20c5-4258-ad31-4d2b2e09365c","Type":"ContainerDied","Data":"aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74"}
Jul 29 20:26:32.077912 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.077838    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr" event={"ID":"68f9c10b-20c5-4258-ad31-4d2b2e09365c","Type":"ContainerDied","Data":"08521553e9ed7b26afd84ec2bbadd09764ef5388c6a650a0249ebad21f4f8365"}
Jul 29 20:26:32.077912 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.077861    2531 scope.go:117] "RemoveContainer" containerID="aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74"
Jul 29 20:26:32.087483 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.087467    2531 scope.go:117] "RemoveContainer" containerID="6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5"
Jul 29 20:26:32.095880 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.095863    2531 scope.go:117] "RemoveContainer" containerID="aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74"
Jul 29 20:26:32.096126 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:26:32.096102    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74\": container with ID starting with aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74 not found: ID does not exist" containerID="aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74"
Jul 29 20:26:32.096186 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.096138    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74"} err="failed to get container status \"aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74\": rpc error: code = NotFound desc = could not find container \"aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74\": container with ID starting with aff4d5f0b69e3acdb23fe2f780818a4a30efe717a7a3a34a5185681e894f1c74 not found: ID does not exist"
Jul 29 20:26:32.096186 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.096157    2531 scope.go:117] "RemoveContainer" containerID="6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5"
Jul 29 20:26:32.096387 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:26:32.096372    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5\": container with ID starting with 6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5 not found: ID does not exist" containerID="6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5"
Jul 29 20:26:32.096435 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.096391    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5"} err="failed to get container status \"6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5\": rpc error: code = NotFound desc = could not find container \"6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5\": container with ID starting with 6145a0c9836f1bc88156d59b874eacb4604226b0744ecc798f5d0d3aecc329d5 not found: ID does not exist"
Jul 29 20:26:32.101154 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.101134    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"]
Jul 29 20:26:32.105179 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.105159    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7d4a80-openshift-default-64dbf79f84-n4jzr"]
Jul 29 20:26:32.372699 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:32.372620    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" path="/var/lib/kubelet/pods/68f9c10b-20c5-4258-ad31-4d2b2e09365c/volumes"
Jul 29 20:26:37.032517 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.032476    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"]
Jul 29 20:26:37.032983 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.032753    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd" podUID="db3a4024-7bfc-4a1f-b2f5-3936f8208392" containerName="payload-pre-processing" containerID="cri-o://6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94" gracePeriod=30
Jul 29 20:26:37.198657 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.198619    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"]
Jul 29 20:26:37.200645 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.200616    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1a1eaa-m8zc6"]
Jul 29 20:26:37.289715 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.289661    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:26:37.367017 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.366990    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db3a4024-7bfc-4a1f-b2f5-3936f8208392-plugins-config-volume\") pod \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") "
Jul 29 20:26:37.367213 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.367040    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbzhs\" (UniqueName: \"kubernetes.io/projected/db3a4024-7bfc-4a1f-b2f5-3936f8208392-kube-api-access-jbzhs\") pod \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\" (UID: \"db3a4024-7bfc-4a1f-b2f5-3936f8208392\") "
Jul 29 20:26:37.367394 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.367368    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db3a4024-7bfc-4a1f-b2f5-3936f8208392-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "db3a4024-7bfc-4a1f-b2f5-3936f8208392" (UID: "db3a4024-7bfc-4a1f-b2f5-3936f8208392"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:26:37.369244 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.369225    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3a4024-7bfc-4a1f-b2f5-3936f8208392-kube-api-access-jbzhs" (OuterVolumeSpecName: "kube-api-access-jbzhs") pod "db3a4024-7bfc-4a1f-b2f5-3936f8208392" (UID: "db3a4024-7bfc-4a1f-b2f5-3936f8208392"). InnerVolumeSpecName "kube-api-access-jbzhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:26:37.468085 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.468022    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbzhs\" (UniqueName: \"kubernetes.io/projected/db3a4024-7bfc-4a1f-b2f5-3936f8208392-kube-api-access-jbzhs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:37.468085 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:37.468084    2531 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/db3a4024-7bfc-4a1f-b2f5-3936f8208392-plugins-config-volume\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:38.109406 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.109370    2531 generic.go:356] "Generic (PLEG): container finished" podID="db3a4024-7bfc-4a1f-b2f5-3936f8208392" containerID="6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94" exitCode=0
Jul 29 20:26:38.109406 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.109408    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd" event={"ID":"db3a4024-7bfc-4a1f-b2f5-3936f8208392","Type":"ContainerDied","Data":"6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94"}
Jul 29 20:26:38.109940 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.109414    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"
Jul 29 20:26:38.109940 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.109450    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd" event={"ID":"db3a4024-7bfc-4a1f-b2f5-3936f8208392","Type":"ContainerDied","Data":"d173102cdbad26c2e6baae42af082e8d8a659b8ce11409261b592c6a067dfb9b"}
Jul 29 20:26:38.109940 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.109473    2531 scope.go:117] "RemoveContainer" containerID="6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94"
Jul 29 20:26:38.118254 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.118236    2531 scope.go:117] "RemoveContainer" containerID="6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94"
Jul 29 20:26:38.118503 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:26:38.118480    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94\": container with ID starting with 6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94 not found: ID does not exist" containerID="6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94"
Jul 29 20:26:38.118560 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.118511    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94"} err="failed to get container status \"6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94\": rpc error: code = NotFound desc = could not find container \"6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94\": container with ID starting with 6f9b8a2835648f24d1ebd7503fb994883e3f918492d0c69c1d0114f850c7ad94 not found: ID does not exist"
Jul 29 20:26:38.131299 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.131266    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"]
Jul 29 20:26:38.135928 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.135898    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1a1eaa-66cddccb96-bgwfd"]
Jul 29 20:26:38.371731 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.371651    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="111e9611-0785-418a-8f47-04474c5193b9" path="/var/lib/kubelet/pods/111e9611-0785-418a-8f47-04474c5193b9/volumes"
Jul 29 20:26:38.372001 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:38.371987    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db3a4024-7bfc-4a1f-b2f5-3936f8208392" path="/var/lib/kubelet/pods/db3a4024-7bfc-4a1f-b2f5-3936f8208392/volumes"
Jul 29 20:26:44.244541 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:44.244467    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"]
Jul 29 20:26:44.245110 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:44.244665    2531 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy" containerID="cri-o://954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc" gracePeriod=30
Jul 29 20:26:49.492341 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.492317    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:26:49.574722 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574637    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-socket\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574722 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574679    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-certs\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574730    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-envoy\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574762    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-data\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574792    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-token\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574821    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istiod-ca-cert\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574846    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-credential-socket\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574881    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-podinfo\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574915    2531 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2q4t\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-kube-api-access-j2q4t\") pod \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\" (UID: \"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5\") "
Jul 29 20:26:49.574948 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.574929    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:49.575406 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.575136    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:49.575406 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.575182    2531 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.575517 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.575481    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 20:26:49.575903 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.575328    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:49.576353 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.576324    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:49.577282 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.577251    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 20:26:49.577385 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.577299    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 20:26:49.577385 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.577326    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:26:49.577467 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.577457    2531 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-kube-api-access-j2q4t" (OuterVolumeSpecName: "kube-api-access-j2q4t") pod "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" (UID: "e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5"). InnerVolumeSpecName "kube-api-access-j2q4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 20:26:49.676407 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676373    2531 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istiod-ca-cert\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.676407 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676400    2531 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-credential-socket\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.676407 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676420    2531 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-podinfo\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.676654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676429    2531 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2q4t\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-kube-api-access-j2q4t\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.676654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676439    2531 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-workload-certs\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.676654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676447    2531 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-envoy\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.676654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676455    2531 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-data\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:49.676654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:49.676462    2531 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5-istio-token\") on node \"ip-10-0-131-41.ec2.internal\" DevicePath \"\""
Jul 29 20:26:50.168047 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.168008    2531 generic.go:356] "Generic (PLEG): container finished" podID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerID="954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc" exitCode=0
Jul 29 20:26:50.168275 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.168089    2531 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"
Jul 29 20:26:50.168275 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.168093    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" event={"ID":"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5","Type":"ContainerDied","Data":"954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc"}
Jul 29 20:26:50.168275 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.168149    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7" event={"ID":"e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5","Type":"ContainerDied","Data":"96a3736b8330f267ff4fd7aff65e46ba458655080cb4442e2f0c64b5ac0a992a"}
Jul 29 20:26:50.168275 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.168172    2531 scope.go:117] "RemoveContainer" containerID="954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc"
Jul 29 20:26:50.177398 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.177377    2531 scope.go:117] "RemoveContainer" containerID="b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9"
Jul 29 20:26:50.185245 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.185226    2531 scope.go:117] "RemoveContainer" containerID="954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc"
Jul 29 20:26:50.185479 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:26:50.185461    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc\": container with ID starting with 954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc not found: ID does not exist" containerID="954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc"
Jul 29 20:26:50.185528 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.185488    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc"} err="failed to get container status \"954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc\": rpc error: code = NotFound desc = could not find container \"954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc\": container with ID starting with 954aa8c4fff762724245157c10d17b1f570021131a5dc447905dd672f2b4f9cc not found: ID does not exist"
Jul 29 20:26:50.185528 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.185505    2531 scope.go:117] "RemoveContainer" containerID="b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9"
Jul 29 20:26:50.185721 ip-10-0-131-41 kubenswrapper[2531]: E0729 20:26:50.185703    2531 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9\": container with ID starting with b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9 not found: ID does not exist" containerID="b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9"
Jul 29 20:26:50.185767 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.185729    2531 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9"} err="failed to get container status \"b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9\": rpc error: code = NotFound desc = could not find container \"b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9\": container with ID starting with b926573b43c1b1fbdc2af49e827de3188e4ffdbbbbc06c282466a853f9f157a9 not found: ID does not exist"
Jul 29 20:26:50.192692 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.192667    2531 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"]
Jul 29 20:26:50.198134 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.198113    2531 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1eaa-openshift-default-69dc44b98d-gssl7"]
Jul 29 20:26:50.372115 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.372085    2531 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" path="/var/lib/kubelet/pods/e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5/volumes"
Jul 29 20:26:50.417982 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.417960    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vh6td_4b9f7dc5-5554-4582-890b-b6b01b2f9110/server/0.log"
Jul 29 20:26:50.885022 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.884995    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d75b7b96-vhrgv_8fb359f4-d7d1-4468-bdda-2e7a01f08538/copy-manifests/0.log"
Jul 29 20:26:50.897695 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:50.897672    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d75b7b96-vhrgv_8fb359f4-d7d1-4468-bdda-2e7a01f08538/manager/0.log"
Jul 29 20:26:51.363110 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:51.363080    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755905-xp8xv_8f1d115c-d9ca-4fbf-9270-6f66fe18f431/cleanup/0.log"
Jul 29 20:26:51.475109 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:51.475083    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755920-8scn2_ccd1c66a-dd7b-4132-93d9-d0df6668cb5f/cleanup/0.log"
Jul 29 20:26:52.440566 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.440538    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9_0f16cb72-18c1-4581-9ab1-1abc90ab35cc/extract/0.log"
Jul 29 20:26:52.446696 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.446665    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9_0f16cb72-18c1-4581-9ab1-1abc90ab35cc/util/0.log"
Jul 29 20:26:52.453513 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.453490    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9_0f16cb72-18c1-4581-9ab1-1abc90ab35cc/pull/0.log"
Jul 29 20:26:52.563348 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.563322    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9_9fa136d3-2961-471f-a61a-2430f256969b/util/0.log"
Jul 29 20:26:52.569606 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.569582    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9_9fa136d3-2961-471f-a61a-2430f256969b/pull/0.log"
Jul 29 20:26:52.575608 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.575590    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9_9fa136d3-2961-471f-a61a-2430f256969b/extract/0.log"
Jul 29 20:26:52.684803 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.684773    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz_dc5b3d63-80b6-4518-bbf6-28a9930fe58c/util/0.log"
Jul 29 20:26:52.694884 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.694830    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz_dc5b3d63-80b6-4518-bbf6-28a9930fe58c/pull/0.log"
Jul 29 20:26:52.701491 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.701476    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz_dc5b3d63-80b6-4518-bbf6-28a9930fe58c/extract/0.log"
Jul 29 20:26:52.804849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.804826    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq_0d83a104-6ee8-44a6-bd0e-6abf70c065e1/util/0.log"
Jul 29 20:26:52.810542 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.810522    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq_0d83a104-6ee8-44a6-bd0e-6abf70c065e1/pull/0.log"
Jul 29 20:26:52.816373 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:52.816353    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq_0d83a104-6ee8-44a6-bd0e-6abf70c065e1/extract/0.log"
Jul 29 20:26:54.077178 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:54.077150    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g_ef7583ea-3184-45fc-acb5-2002cb10d3d7/istio-proxy/0.log"
Jul 29 20:26:54.187295 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:54.187264    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkl2t_3a65cb93-4f0b-4455-8880-3b06aad492e0/discovery/0.log"
Jul 29 20:26:54.635813 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:54.635777    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-82w2k_d355e025-5bdc-4459-93bb-11cae9eb1d23/payload-pre-processing/0.log"
Jul 29 20:26:55.302532 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:55.302507    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fhdwz_7ed63859-e94f-4f94-b8a5-b98f8e991d13/main/0.log"
Jul 29 20:26:55.407252 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:26:55.407221    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4bqdw_d29a9684-9a65-460c-9387-ebef2269aee4/main/0.log"
Jul 29 20:27:03.858677 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:03.858645    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rhc8g_0a0a7dc2-9efc-43b0-bd20-0aeda1a3a901/global-pull-secret-syncer/0.log"
Jul 29 20:27:03.993002 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:03.992969    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qczjm_c4fe53de-2bc3-41e4-b90a-f10105952e63/konnectivity-agent/0.log"
Jul 29 20:27:04.016235 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:04.016206    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-41.ec2.internal_462cce6739494a25cb79bf723aa5b093/haproxy/0.log"
Jul 29 20:27:08.901004 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:08.900974    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9_0f16cb72-18c1-4581-9ab1-1abc90ab35cc/extract/0.log"
Jul 29 20:27:08.924857 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:08.924831    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9_0f16cb72-18c1-4581-9ab1-1abc90ab35cc/util/0.log"
Jul 29 20:27:08.948800 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:08.948778    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p8fp9_0f16cb72-18c1-4581-9ab1-1abc90ab35cc/pull/0.log"
Jul 29 20:27:08.983594 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:08.983572    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9_9fa136d3-2961-471f-a61a-2430f256969b/extract/0.log"
Jul 29 20:27:09.023444 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.023419    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9_9fa136d3-2961-471f-a61a-2430f256969b/util/0.log"
Jul 29 20:27:09.047572 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.047550    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqvz9_9fa136d3-2961-471f-a61a-2430f256969b/pull/0.log"
Jul 29 20:27:09.075724 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.075701    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz_dc5b3d63-80b6-4518-bbf6-28a9930fe58c/extract/0.log"
Jul 29 20:27:09.098791 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.098768    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz_dc5b3d63-80b6-4518-bbf6-28a9930fe58c/util/0.log"
Jul 29 20:27:09.123943 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.123924    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mcvkz_dc5b3d63-80b6-4518-bbf6-28a9930fe58c/pull/0.log"
Jul 29 20:27:09.153849 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.153785    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq_0d83a104-6ee8-44a6-bd0e-6abf70c065e1/extract/0.log"
Jul 29 20:27:09.181967 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.181942    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq_0d83a104-6ee8-44a6-bd0e-6abf70c065e1/util/0.log"
Jul 29 20:27:09.207761 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:09.207734    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n7jdq_0d83a104-6ee8-44a6-bd0e-6abf70c065e1/pull/0.log"
Jul 29 20:27:12.365736 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:12.365710    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dsn5z_755d07d1-d1ba-41ea-88c5-cf689b7d5684/node-exporter/0.log"
Jul 29 20:27:12.388225 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:12.388196    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dsn5z_755d07d1-d1ba-41ea-88c5-cf689b7d5684/kube-rbac-proxy/0.log"
Jul 29 20:27:12.410966 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:12.410939    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dsn5z_755d07d1-d1ba-41ea-88c5-cf689b7d5684/init-textfile/0.log"
Jul 29 20:27:14.212625 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.212581    2531 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"]
Jul 29 20:27:14.213257 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213235    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy"
Jul 29 20:27:14.213342 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213261    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy"
Jul 29 20:27:14.213342 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213279    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy"
Jul 29 20:27:14.213342 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213287    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy"
Jul 29 20:27:14.213342 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213309    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy"
Jul 29 20:27:14.213538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213320    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy"
Jul 29 20:27:14.213538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213378    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="111e9611-0785-418a-8f47-04474c5193b9" containerName="revoke-keys"
Jul 29 20:27:14.213538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213389    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="111e9611-0785-418a-8f47-04474c5193b9" containerName="revoke-keys"
Jul 29 20:27:14.213538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213412    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy"
Jul 29 20:27:14.213538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213421    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ceb61e-57e1-4a00-965d-d4b74f5730ee" containerName="istio-proxy"
Jul 29 20:27:14.213538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213438    2531 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db3a4024-7bfc-4a1f-b2f5-3936f8208392" containerName="payload-pre-processing"
Jul 29 20:27:14.213538 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213447    2531 state_mem.go:107] "Deleted CPUSet assignment" podUID="db3a4024-7bfc-4a1f-b2f5-3936f8208392" containerName="payload-pre-processing"
Jul 29 20:27:14.213855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213574    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="111e9611-0785-418a-8f47-04474c5193b9" containerName="revoke-keys"
Jul 29 20:27:14.213855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213590    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f9c10b-20c5-4258-ad31-4d2b2e09365c" containerName="istio-proxy"
Jul 29 20:27:14.213855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213600    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5345f80-0e31-45d3-a1ac-ab6fefe9b3e5" containerName="istio-proxy"
Jul 29 20:27:14.213855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.213610    2531 memory_manager.go:368] "RemoveStaleState removing state" podUID="db3a4024-7bfc-4a1f-b2f5-3936f8208392" containerName="payload-pre-processing"
Jul 29 20:27:14.217043 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.217018    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.219659 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.219633    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cq5dz\"/\"openshift-service-ca.crt\""
Jul 29 20:27:14.220524 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.220508    2531 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cq5dz\"/\"default-dockercfg-8c6m4\""
Jul 29 20:27:14.220579 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.220551    2531 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cq5dz\"/\"kube-root-ca.crt\""
Jul 29 20:27:14.224629 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.224606    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"]
Jul 29 20:27:14.271521 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.271486    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-sys\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.271686 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.271552    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-proc\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.271686 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.271607    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqjn4\" (UniqueName: \"kubernetes.io/projected/415ccc3d-6453-499e-94e6-3262cf3e9373-kube-api-access-kqjn4\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.271686 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.271634    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-lib-modules\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.271686 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.271667    2531 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-podres\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.297632 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.297605    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-vkr8r_810e31bc-c12c-42ca-aee7-310ad8a18cab/networking-console-plugin/0.log"
Jul 29 20:27:14.372269 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372241    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-sys\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372451 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372280    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-proc\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372451 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372310    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqjn4\" (UniqueName: \"kubernetes.io/projected/415ccc3d-6453-499e-94e6-3262cf3e9373-kube-api-access-kqjn4\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372451 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372368    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-sys\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372451 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372393    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-lib-modules\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372451 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372374    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-proc\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372451 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372442    2531 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-podres\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372524    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-lib-modules\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.372654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.372571    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/415ccc3d-6453-499e-94e6-3262cf3e9373-podres\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.381410 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.381388    2531 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqjn4\" (UniqueName: \"kubernetes.io/projected/415ccc3d-6453-499e-94e6-3262cf3e9373-kube-api-access-kqjn4\") pod \"perf-node-gather-daemonset-rn59t\" (UID: \"415ccc3d-6453-499e-94e6-3262cf3e9373\") " pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.527679 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.527596    2531 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:14.657758 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:14.657734    2531 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"]
Jul 29 20:27:14.659859 ip-10-0-131-41 kubenswrapper[2531]: W0729 20:27:14.659836    2531 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod415ccc3d_6453_499e_94e6_3262cf3e9373.slice/crio-998c3b10692226d2aa5304a944ed39518ae15d07201e04d64ddde868b3f70816 WatchSource:0}: Error finding container 998c3b10692226d2aa5304a944ed39518ae15d07201e04d64ddde868b3f70816: Status 404 returned error can't find the container with id 998c3b10692226d2aa5304a944ed39518ae15d07201e04d64ddde868b3f70816
Jul 29 20:27:15.286923 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:15.286891    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t" event={"ID":"415ccc3d-6453-499e-94e6-3262cf3e9373","Type":"ContainerStarted","Data":"bb83b984db243736cbe946888897932390d4dc12cbc9a1ab2a75cc422d9def84"}
Jul 29 20:27:15.287406 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:15.286950    2531 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t" event={"ID":"415ccc3d-6453-499e-94e6-3262cf3e9373","Type":"ContainerStarted","Data":"998c3b10692226d2aa5304a944ed39518ae15d07201e04d64ddde868b3f70816"}
Jul 29 20:27:15.287406 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:15.286990    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:15.304717 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:15.304664    2531 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t" podStartSLOduration=1.304648882 podStartE2EDuration="1.304648882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:27:15.302312819 +0000 UTC m=+3443.456571440" watchObservedRunningTime="2026-07-29 20:27:15.304648882 +0000 UTC m=+3443.458907500"
Jul 29 20:27:17.214463 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:17.214423    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bf2bv_116d0690-db5c-4337-8ca6-8f5b82918f63/dns/0.log"
Jul 29 20:27:17.237658 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:17.237633    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bf2bv_116d0690-db5c-4337-8ca6-8f5b82918f63/kube-rbac-proxy/0.log"
Jul 29 20:27:17.427196 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:17.427166    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zw6kc_a5e00286-0955-436b-bf31-2e3787ce8c46/dns-node-resolver/0.log"
Jul 29 20:27:18.107855 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:18.107812    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvxnr_5bdc4868-d5c0-4f51-a622-2d53db99bdaf/node-ca/0.log"
Jul 29 20:27:19.098726 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:19.098700    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g_ef7583ea-3184-45fc-acb5-2002cb10d3d7/istio-proxy/0.log"
Jul 29 20:27:19.241908 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:19.241876    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkl2t_3a65cb93-4f0b-4455-8880-3b06aad492e0/discovery/0.log"
Jul 29 20:27:19.389952 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:19.389874    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-82w2k_d355e025-5bdc-4459-93bb-11cae9eb1d23/payload-pre-processing/0.log"
Jul 29 20:27:20.298513 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:20.298485    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4b4kb_5a49f525-ae27-4e28-99b0-3b3d9fd1b693/serve-healthcheck-canary/0.log"
Jul 29 20:27:20.953135 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:20.953103    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxkqn_e1fbdccb-dbb0-4f59-aad1-c2b9c2332006/kube-rbac-proxy/0.log"
Jul 29 20:27:20.977065 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:20.977036    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxkqn_e1fbdccb-dbb0-4f59-aad1-c2b9c2332006/exporter/0.log"
Jul 29 20:27:21.001112 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:21.001079    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxkqn_e1fbdccb-dbb0-4f59-aad1-c2b9c2332006/extractor/0.log"
Jul 29 20:27:21.301448 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:21.301379    2531 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cq5dz/perf-node-gather-daemonset-rn59t"
Jul 29 20:27:23.980394 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:23.980370    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vh6td_4b9f7dc5-5554-4582-890b-b6b01b2f9110/server/0.log"
Jul 29 20:27:24.279994 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:24.279917    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d75b7b96-vhrgv_8fb359f4-d7d1-4468-bdda-2e7a01f08538/manager/0.log"
Jul 29 20:27:24.302552 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:24.302523    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d75b7b96-vhrgv_8fb359f4-d7d1-4468-bdda-2e7a01f08538/copy-manifests/0.log"
Jul 29 20:27:24.897300 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:24.897271    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g_ef7583ea-3184-45fc-acb5-2002cb10d3d7/istio-proxy/0.log"
Jul 29 20:27:25.033607 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:25.033577    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkl2t_3a65cb93-4f0b-4455-8880-3b06aad492e0/discovery/0.log"
Jul 29 20:27:25.138654 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:25.138627    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-82w2k_d355e025-5bdc-4459-93bb-11cae9eb1d23/payload-pre-processing/0.log"
Jul 29 20:27:25.615886 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:25.615804    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fcbbc6665-gd98b_c40d7206-03da-4fbe-8f6b-eb15ee7ea891/manager/0.log"
Jul 29 20:27:26.655763 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:26.655732    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ctrp2g_ef7583ea-3184-45fc-acb5-2002cb10d3d7/istio-proxy/0.log"
Jul 29 20:27:26.793321 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:26.793288    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vkl2t_3a65cb93-4f0b-4455-8880-3b06aad492e0/discovery/0.log"
Jul 29 20:27:26.901495 ip-10-0-131-41 kubenswrapper[2531]: I0729 20:27:26.901460    2531 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-82w2k_d355e025-5bdc-4459-93bb-11cae9eb1d23/payload-pre-processing/0.log"