Jul 07 11:26:56.852979 ip-10-0-129-12 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 11:26:57.216765 ip-10-0-129-12 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 11:26:57.216765 ip-10-0-129-12 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 11:26:57.216765 ip-10-0-129-12 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 11:26:57.216765 ip-10-0-129-12 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 11:26:57.216765 ip-10-0-129-12 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 11:26:57.217747 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.217651    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 11:26:57.223449 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223423    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:26:57.223449 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223443    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:26:57.223449 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223447    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:26:57.223449 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223450    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:26:57.223449 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223453    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:26:57.223449 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223457    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:26:57.223449 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223459    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223465    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223470    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223473    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223475    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223478    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223481    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223484    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223486    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223489    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223491    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223494    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223500    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223503    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223505    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223508    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223510    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223513    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223515    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223518    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:26:57.223753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223521    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223524    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223526    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223529    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223532    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223534    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223537    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223539    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223542    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223544    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223547    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223549    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223551    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223554    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223557    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223559    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223562    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223564    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223567    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223569    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:26:57.224289 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223572    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223574    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223576    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223579    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223583    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223586    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223588    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223591    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223594    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223598    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223600    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223605    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223607    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223610    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223652    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223656    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223659    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223662    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223665    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223668    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:26:57.224797 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223670    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223673    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223676    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223678    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223681    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223683    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223686    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223689    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223691    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223694    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223696    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223699    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223702    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223705    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223707    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223710    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223712    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223716    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223718    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223720    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:26:57.225273 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223723    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223725    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223728    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223731    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223733    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223736    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223741    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223745    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223748    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223752    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223756    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223759    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:26:57.225771 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.223762    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225951    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225959    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225963    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225966    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225969    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225972    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225975    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225978    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225980    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225983    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225986    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225988    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225990    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225993    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225996    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.225998    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226001    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226004    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226007    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:26:57.226058 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226009    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226012    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226014    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226017    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226019    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226021    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226024    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226026    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226029    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226031    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226034    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226037    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226039    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226042    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226044    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226047    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226049    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226052    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226054    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226057    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:26:57.226551 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226059    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226062    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226065    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226067    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226070    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226073    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226075    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226077    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226079    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226082    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226084    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226088    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226091    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226093    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226096    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226098    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226102    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226104    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226106    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226109    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:26:57.227082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226112    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226115    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226117    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226122    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226125    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226129    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226132    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226134    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226137    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226140    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226142    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226146    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226149    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226152    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226154    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226156    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226158    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226161    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226163    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:26:57.227586 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226167    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226171    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226174    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226178    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226181    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226184    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226187    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226190    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226193    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226196    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226199    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226201    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226203    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226206    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226208    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226211    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226214    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226216    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226219    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:26:57.228065 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226221    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226224    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226623    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226651    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226659    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226663    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226666    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226669    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226672    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226674    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226677    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226680    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226682    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226685    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226688    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226691    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226694    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226697    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:26:57.228545 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226700    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226703    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226706    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226710    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226713    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226716    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226719    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226722    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226725    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226727    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226731    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226733    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226736    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226738    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226740    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226743    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226745    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226748    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226750    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226752    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:26:57.229048 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226754    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226757    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226759    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226762    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226764    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226766    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226769    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226772    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226774    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226777    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226779    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226782    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226785    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226788    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226791    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226793    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226796    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226798    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226801    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226803    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:26:57.229537 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226805    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226808    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226810    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226813    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226815    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226818    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226820    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226823    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226825    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226827    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226830    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226832    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226834    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226837    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226839    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226842    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226844    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226846    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226849    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226851    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:26:57.230035 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226853    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226856    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226858    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226860    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226863    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226865    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226868    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226871    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226874    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226876    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226878    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226884    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226888    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226890    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226892    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226895    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226897    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226899    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226902    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226904    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:26:57.230543 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226906    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226909    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.226911    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227009    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227035    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227044    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227048    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227053    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227057    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227061    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227068    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227072    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227075    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227079    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227082    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227085    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227088    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227092    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227095    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227098    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227101    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227105    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227108    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227111    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 11:26:57.231041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227114    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227117    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227121    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227123    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227126    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227129    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227132    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227135    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227138    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227141    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227144    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227148    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227153    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227156    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227159    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227162    2564 flags.go:64] FLAG: --enable-server="true"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227165    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227170    2564 flags.go:64] FLAG: --event-burst="100"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227173    2564 flags.go:64] FLAG: --event-qps="50"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227176    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227179    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227181    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227185    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227188    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227191    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 11:26:57.231624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227194    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227196    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227199    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227202    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227205    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227208    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227211    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227214    2564 flags.go:64] FLAG: --feature-gates=""
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227217    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227220    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227224    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227227    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227229    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227232    2564 flags.go:64] FLAG: --help="false"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227235    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227238    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227241    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227244    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227247    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227253    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227257    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227259    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227262    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 11:26:57.232262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227265    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227268    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227271    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227274    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227277    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227280    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227282    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227285    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227288    2564 flags.go:64] FLAG: --lock-file=""
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227290    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227293    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227296    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227301    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227304    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227307    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227310    2564 flags.go:64] FLAG: --logging-format="text"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227312    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227316    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227318    2564 flags.go:64] FLAG: --manifest-url=""
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227321    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227326    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227329    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227333    2564 flags.go:64] FLAG: --max-pods="110"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227335    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227338    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 11:26:57.232859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227341    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227344    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227347    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227353    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227356    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227364    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227367    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227370    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227373    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227376    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227381    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227384    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227387    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227390    2564 flags.go:64] FLAG: --port="10250"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227393    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227395    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c02e6e3777c5ad9"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227399    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227402    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227404    2564 flags.go:64] FLAG: --register-node="true"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227407    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227410    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227413    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227416    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227419    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227422    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 11:26:57.233463 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227425    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227428    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227431    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227434    2564 flags.go:64] FLAG: --runonce="false"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227436    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227439    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227441    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227444    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227447    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227449    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227454    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227458    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227461    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227464    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227467    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227470    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227473    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227475    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227478    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227484    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227487    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227490    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227494    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227496    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227499    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 11:26:57.234136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227501    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227504    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227507    2564 flags.go:64] FLAG: --v="2"
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227511    2564 flags.go:64] FLAG: --version="false"
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227515    2564 flags.go:64] FLAG: --vmodule=""
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227519    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.227522    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227674    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227679    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227683    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227686    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227689    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227692    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227695    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227697    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227700    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227703    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227708    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227712    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227714    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227717    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:26:57.234861 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227721    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227724    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227728    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227730    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227733    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227737    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227740    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227743    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227746    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227749    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227751    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227754    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227756    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227759    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227761    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227764    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227766    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227768    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227771    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227773    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:26:57.235380 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227776    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227778    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227780    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227782    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227785    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227787    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227789    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227792    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227797    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227800    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227803    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227805    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227808    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227811    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227814    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227816    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227818    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227821    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227823    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:26:57.235866 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227826    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227828    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227831    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227834    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227836    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227838    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227841    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227843    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227845    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227848    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227850    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227852    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227855    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227857    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227859    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227862    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227864    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227867    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227869    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227871    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:26:57.236340 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227873    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227878    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227881    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227884    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227886    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227889    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227891    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227894    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227897    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227899    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227902    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227904    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227907    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227909    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227912    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227914    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227916    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227919    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227921    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227923    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:26:57.236841 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227926    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227929    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227931    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227935    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227938    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.227941    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.228544    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.235962    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.235983    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.236004    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.236012    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236067    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236073    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236076    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:26:57.237339 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236080    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236083    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236086    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236088    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236091    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236094    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236097    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236100    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236102    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236105    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236107    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236109    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236120    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236123    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236126    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236128    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236131    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236134    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236136    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236139    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:26:57.237707 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236142    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236144    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236147    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236149    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236152    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236155    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236158    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236160    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236164    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236168    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236171    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236174    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236177    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236180    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236183    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236185    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236188    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236190    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236194    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236196    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:26:57.238197 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236199    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236202    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236206    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236209    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236212    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236214    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236217    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236220    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236223    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236226    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236229    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236231    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236234    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236236    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236239    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236241    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236245    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236248    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236250    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:26:57.238844 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236253    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236255    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236258    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236260    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236262    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236265    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236267    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236269    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236272    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236274    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236277    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236279    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236282    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236285    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236287    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236291    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236294    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236297    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236300    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236302    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:26:57.239321 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236304    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236307    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236309    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236311    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236314    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236317    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236320    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236322    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236325    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236328    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236330    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236333    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236335    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236338    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236340    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236343    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:26:57.239843 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236345    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.236351    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236466    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236470    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236473    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236475    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236478    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236480    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236483    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236486    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236488    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236490    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236493    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236495    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236498    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:26:57.240250 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236500    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236502    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236505    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236508    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236512    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236515    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236518    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236520    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236523    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236526    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236529    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236532    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236534    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236537    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236539    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236541    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236544    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236546    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236548    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236551    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:26:57.240618 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236553    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236556    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236558    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236561    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236563    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236565    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236568    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236571    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236573    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236576    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236578    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236581    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236583    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236586    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236588    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236591    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236593    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236597    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236600    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:26:57.241121 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236604    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236606    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236609    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236612    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236614    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236617    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236620    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236623    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236644    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236649    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236651    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236654    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236656    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236659    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236661    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236664    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236666    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236668    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236671    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236673    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:26:57.241581 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236675    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236680    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236683    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236687    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236689    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236692    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236695    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236697    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236700    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236702    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236704    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236707    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236710    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236712    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236714    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236717    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236719    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236722    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236724    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:26:57.242071 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236727    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236729    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236731    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236734    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236737    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236739    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236742    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:57.236744    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.236749    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.236897    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.239364    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.240797    2564 server.go:1019] "Starting client certificate rotation"
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.240894    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 11:26:57.242531 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.240925    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 11:26:57.243355 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.243341    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 11:26:57.244881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.244863    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 11:26:57.255058 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.255032    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 07 11:26:57.257494 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.257474    2564 log.go:25] "Validated CRI v1 image API"
Jul 07 11:26:57.259301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.259283    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 11:26:57.264038 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.264014    2564 fs.go:135] Filesystem UUIDs: map[2b60b3d7-2ef4-41de-8871-cd80911c9d3f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a28f318f-a49b-4a9a-9c4e-9ab32d479122:/dev/nvme0n1p3]
Jul 07 11:26:57.264131 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.264036    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 11:26:57.269777 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.269604    2564 manager.go:216] Machine: {Timestamp:2026-07-07 11:26:57.267925417 +0000 UTC m=+0.307150109 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100090 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b0daca705ba5bed3ac99e9e978d12 SystemUUID:ec2b0dac-a705-ba5b-ed3a-c99e9e978d12 BootID:faf5c3c6-99de-48ac-b629-b2d37eb26cf8 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:2b:ed:cb:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:2b:ed:cb:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:44:11:ea:b0:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 11:26:57.269777 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.269760    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 11:26:57.269929 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.269903    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 11:26:57.273254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.273220    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 11:26:57.273444 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.273259    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 11:26:57.274053 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.274041    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 11:26:57.274107 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.274060    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 11:26:57.274107 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.274070    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 11:26:57.274397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.274380    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 11:26:57.274805 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.274791    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 11:26:57.276858 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.276843    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 11:26:57.281229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.281213    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 11:26:57.281570 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.281556    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 11:26:57.281655 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.281606    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 11:26:57.281655 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.281622    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 11:26:57.281749 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.281658    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 11:26:57.281749 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.281673    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 07 11:26:57.281749 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.281686    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 11:26:57.282089 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.282074    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 11:26:57.282152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.282097    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 11:26:57.284957 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.284935    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 11:26:57.287841 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.287821    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 11:26:57.287927 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.287857    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 11:26:57.289302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289275    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 11:26:57.289302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289304    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289313    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289322    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289336    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289346    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289359    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289369    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289388    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 11:26:57.289445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289397    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 11:26:57.289699 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289450    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 11:26:57.289699 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.289461    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 11:26:57.290480 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.290459    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 11:26:57.290535 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.290501    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 11:26:57.292017 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.291972    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 11:26:57.292262 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.291975    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 11:26:57.292576 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.292559    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 11:26:57.294553 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.294538    2564 server.go:1268] "Started kubelet"
Jul 07 11:26:57.294667 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.294623    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 11:26:57.294722 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.294687    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4gfhb"
Jul 07 11:26:57.294766 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.294688    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 11:26:57.294766 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.294759    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 11:26:57.295436 ip-10-0-129-12 systemd[1]: Started Kubernetes Kubelet.
Jul 07 11:26:57.296577 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.296565    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 11:26:57.296675 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.296660    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 11:26:57.300870 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.300845    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 11:26:57.301798 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.300887    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18bffe54b8e19d10  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-07 11:26:57.29450728 +0000 UTC m=+0.333731971,LastTimestamp:2026-07-07 11:26:57.29450728 +0000 UTC m=+0.333731971,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}"
Jul 07 11:26:57.302873 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.302857    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4gfhb"
Jul 07 11:26:57.304021 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304002    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 11:26:57.304136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304031    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 11:26:57.304136 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.304096    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:57.304750 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304729    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 11:26:57.304827 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304731    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 11:26:57.304827 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304771    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 11:26:57.304914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304861    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 11:26:57.304914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304870    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 11:26:57.305171 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304963    2564 factory.go:55] Registering systemd factory
Jul 07 11:26:57.305171 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.304979    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 07 11:26:57.305286 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.305244    2564 factory.go:153] Registering CRI-O factory
Jul 07 11:26:57.305286 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.305257    2564 factory.go:223] Registration of the crio container factory successfully
Jul 07 11:26:57.305371 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.305304    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 11:26:57.305371 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.305329    2564 factory.go:103] Registering Raw factory
Jul 07 11:26:57.305371 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.305344    2564 manager.go:1196] Started watching for new ooms in manager
Jul 07 11:26:57.306320 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.306291    2564 manager.go:349] Starting recovery of all containers
Jul 07 11:26:57.307830 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.307805    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 11:26:57.307958 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.307921    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 11:26:57.316717 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.316504    2564 manager.go:354] Recovery completed
Jul 07 11:26:57.321996 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.321976    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:26:57.324054 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.324027    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:26:57.324163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.324067    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:26:57.324163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.324082    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:26:57.325721 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.325696    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 11:26:57.325721 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.325719    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 11:26:57.325868 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.325739    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 11:26:57.325868 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.325747    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:26:57.326526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.326511    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:26:57.326569 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.326541    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:26:57.326569 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.326551    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:26:57.328009 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.327996    2564 policy_none.go:49] "None policy: Start"
Jul 07 11:26:57.328066 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.328014    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 11:26:57.328066 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.328025    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 11:26:57.330097 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.330082    2564 policy_none.go:47] "Start"
Jul 07 11:26:57.374369 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.374350    2564 manager.go:337] "Starting Device Plugin manager"
Jul 07 11:26:57.374533 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.374394    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 11:26:57.374533 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.374407    2564 server.go:87] "Starting device plugin registration server"
Jul 07 11:26:57.374815 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.374799    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 11:26:57.374863 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.374819    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 11:26:57.375020 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.374999    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 11:26:57.375146 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.375085    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 11:26:57.375146 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.375093    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 11:26:57.375649 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.375604    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 11:26:57.375749 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.375684    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:57.409910 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.409864    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 11:26:57.415117 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.411312    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 11:26:57.415117 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.411362    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 11:26:57.415117 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.411395    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 11:26:57.415117 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.411437    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 11:26:57.415117 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.413645    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:26:57.475750 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.475666    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:26:57.477507 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.477488    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:26:57.477661 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.477519    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:26:57.477661 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.477534    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:26:57.477661 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.477557    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.486122 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.486094    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.486254 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.486131    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-12.ec2.internal\": node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:57.499713 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.499678    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:57.512210 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.512179    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"]
Jul 07 11:26:57.512305 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.512253    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:26:57.514582 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.514565    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:26:57.514684 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.514619    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:26:57.514684 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.514656    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:26:57.516948 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.516934    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:26:57.517064 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.517048    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.517102 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.517084    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:26:57.518861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.518845    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:26:57.518952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.518871    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:26:57.518952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.518880    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:26:57.518952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.518886    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:26:57.518952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.518900    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:26:57.518952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.518916    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:26:57.521125 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.521107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.521196 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.521148    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:26:57.522033 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.522016    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:26:57.522095 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.522044    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:26:57.522095 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.522058    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:26:57.550617 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.550589    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.555320 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.555301    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.600770 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.600738    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:57.607145 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.607115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.607216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.607152    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.607216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.607172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01502c7c24216826a0dc843b8111a65b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"01502c7c24216826a0dc843b8111a65b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.701092 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.701052    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:57.707451 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.707424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.707524 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.707470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.707524 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.707487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01502c7c24216826a0dc843b8111a65b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"01502c7c24216826a0dc843b8111a65b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.707524 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.707507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/01502c7c24216826a0dc843b8111a65b-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"01502c7c24216826a0dc843b8111a65b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.707624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.707437    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.707624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.707579    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c010214d8710e456690b884b961bbc6a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"c010214d8710e456690b884b961bbc6a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.802001 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.801914    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:57.854421 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.854388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.859615 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:57.859400    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:57.902531 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:57.902494    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:58.003096 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.003054    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:58.103541 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.103510    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 07 11:26:58.163476 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.163456    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:26:58.164141 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.164127    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:26:58.204201 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.204175    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:58.214232 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.214206    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 11:26:58.215702 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.215684    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 07 11:26:58.221578 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.221561    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 11:26:58.240731 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.240698    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 11:26:58.240877 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.240842    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 11:26:58.240925 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.240874    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 11:26:58.240925 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.240874    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 11:26:58.261434 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.261405    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:26:58.282400 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.282375    2564 apiserver.go:52] "Watching apiserver"
Jul 07 11:26:58.289387 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.289357    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 11:26:58.289687 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.289668    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-sng86","openshift-network-diagnostics/network-check-target-vj4xk","openshift-network-operator/iptables-alerter-pxlk5","openshift-ovn-kubernetes/ovnkube-node-rv8qm","kube-system/global-pull-secret-syncer-vsp4z","kube-system/konnectivity-agent-6mbks","kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zchhk","openshift-dns/node-resolver-hqz5q","openshift-image-registry/node-ca-89kg2","openshift-multus/multus-additional-cni-plugins-n4r9t","openshift-multus/network-metrics-daemon-s5js2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"]
Jul 07 11:26:58.291888 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.291869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.293804 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.293781    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:26:58.293899 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.293857    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:26:58.294266 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.294251    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 11:26:58.294323 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.294304    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 11:26:58.294413 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.294402    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 11:26:58.294449 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.294417    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-twsnl\""
Jul 07 11:26:58.294489 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.294457    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 11:26:58.295776 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.295761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.297841 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.297826    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 11:26:58.298109 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.298095    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vdczj\""
Jul 07 11:26:58.298109 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.298105    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 11:26:58.298187 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.298151    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:26:58.298363 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.298350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.300275 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.300259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.300362 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.300318    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:26:58.300503 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.300484    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 11:26:58.300574 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.300520    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 11:26:58.300574 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.300530    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 11:26:58.300896 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.300879    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 11:26:58.301571 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.301557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cc9q6\""
Jul 07 11:26:58.301666 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.301575    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 11:26:58.301666 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.301558    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 11:26:58.302235 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.302222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.304133 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.304111    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 11:26:58.304241 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.304227    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.304467 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.304451    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 11:26:58.304667 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.304653    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8plfh\""
Jul 07 11:26:58.304820 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.304809    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 11:26:58.306515 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.306499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.307409 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.307394    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:26:58.308269 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.308247    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 11:26:58.308269 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.308263    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jcrvv\""
Jul 07 11:26:58.308668 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.308655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.309668 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309614    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 11:21:56 +0000 UTC" deadline="2027-12-27 14:19:37.245833453 +0000 UTC"
Jul 07 11:26:58.309668 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309667    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12914h52m38.936168604s"
Jul 07 11:26:58.309756 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309703    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 11:26:58.309905 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-netns\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.309942 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309917    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mpjj2\""
Jul 07 11:26:58.309942 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:26:58.310003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97-agent-certs\") pod \"konnectivity-agent-6mbks\" (UID: \"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97\") " pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.310003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/daa3b874-9544-44c5-8a23-e7d1a8d3893e-hosts-file\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.310003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.309990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-slash\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.310126 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-host\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.310126 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5649a67-6272-4146-bf87-46e71b52c59f-etc-tuned\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.310126 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa3b874-9544-44c5-8a23-e7d1a8d3893e-tmp-dir\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.310126 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-cni-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.310126 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f43c342d-9285-4c06-a913-c094d92a685a-cni-binary-copy\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.310126 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-socket-dir-parent\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310149    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-log-socket\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-modprobe-d\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysctl-d\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-cnibin\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-cni-bin\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba3f852f-a751-40f8-9751-203da2310fd2-iptables-alerter-script\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-env-overrides\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-systemd\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-cni-multus\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.310397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-var-lib-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.310881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-cni-bin\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.310881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6qh\" (UniqueName: \"kubernetes.io/projected/e5649a67-6272-4146-bf87-46e71b52c59f-kube-api-access-hk6qh\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.310881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-kubelet-config\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.310881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310531    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 11:26:58.310881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.311078 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.310895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba3f852f-a751-40f8-9751-203da2310fd2-host-slash\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.311078 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgp2\" (UniqueName: \"kubernetes.io/projected/ba3f852f-a751-40f8-9751-203da2310fd2-kube-api-access-rhgp2\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.311078 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.311245 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-conf-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.311245 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-etc-kubernetes\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.311470 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-ovnkube-script-lib\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysctl-conf\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311651    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-ovnkube-config\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-lib-modules\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311727    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bszwz\""
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-k8s-cni-cncf-io\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.311864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-kubelet\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-hostroot\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-dbus\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312262    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-ovn\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-kubelet\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-etc-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-kubernetes\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97-konnectivity-ca\") pod \"konnectivity-agent-6mbks\" (UID: \"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97\") " pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312521    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-run\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f43c342d-9285-4c06-a913-c094d92a685a-multus-daemon-config\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.313892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-node-log\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smpp2\" (UniqueName: \"kubernetes.io/projected/df2f33ec-9916-4121-9318-73d89408535c-kube-api-access-smpp2\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysconfig\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-system-cni-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-multus-certs\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdxtn\" (UniqueName: \"kubernetes.io/projected/f43c342d-9285-4c06-a913-c094d92a685a-kube-api-access-pdxtn\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-systemd-units\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-run-netns\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5649a67-6272-4146-bf87-46e71b52c59f-tmp\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.312971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-cni-netd\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.313036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df2f33ec-9916-4121-9318-73d89408535c-ovn-node-metrics-cert\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.313071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-sys\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.313096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-var-lib-kubelet\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.313150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj4wq\" (UniqueName: \"kubernetes.io/projected/daa3b874-9544-44c5-8a23-e7d1a8d3893e-kube-api-access-hj4wq\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.313216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-systemd\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.315190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.313241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-os-release\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.315951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.315404    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 11:26:58.315951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.315424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:26:58.315951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.315494    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9sg47\""
Jul 07 11:26:58.315951 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.315501    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:26:58.315951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.315405    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 11:26:58.317704 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.317688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.319892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.319868    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 11:26:58.319987 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.319905    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bnsx4\""
Jul 07 11:26:58.319987 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.319933    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 11:26:58.319987 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.319948    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 11:26:58.320757 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.320741    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 11:26:58.338233 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.338212    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wpp9l"
Jul 07 11:26:58.346249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.346217    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wpp9l"
Jul 07 11:26:58.405324 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.405301    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 11:26:58.413392 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.413522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.413522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dtj\" (UniqueName: \"kubernetes.io/projected/7761287c-1778-4853-be7c-8a1867dbb173-kube-api-access-72dtj\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.413522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-conf-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-etc-kubernetes\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413477    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.413522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-ovnkube-script-lib\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.413522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-conf-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413536    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-etc-kubernetes\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysctl-conf\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-registration-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-ovnkube-config\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-lib-modules\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-device-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413719    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysctl-conf\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-k8s-cni-cncf-io\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-kubelet\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413781    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-k8s-cni-cncf-io\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-hostroot\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-dbus\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413821    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-kubelet\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-ovn\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.413914 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413861    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-hostroot\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-socket-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-kubelet\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413914    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-ovn\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413923    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-dbus\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-etc-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413964    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-kubelet\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-lib-modules\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-kubernetes\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97-konnectivity-ca\") pod \"konnectivity-agent-6mbks\" (UID: \"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97\") " pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.413989    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-etc-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414039    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-kubernetes\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-run\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414054    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-ovnkube-script-lib\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nptdm\" (UniqueName: \"kubernetes.io/projected/0bb57178-381c-4286-a6be-77b92d7acde2-kube-api-access-nptdm\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.414683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414133    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-ovnkube-config\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414141    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-run\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414166    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2607803-14a5-4125-939d-8fe7b1e40de0-serviceca\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f43c342d-9285-4c06-a913-c094d92a685a-multus-daemon-config\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-node-log\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414238    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-node-log\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smpp2\" (UniqueName: \"kubernetes.io/projected/df2f33ec-9916-4121-9318-73d89408535c-kube-api-access-smpp2\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-sys-fs\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414302    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysconfig\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-system-cni-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-multus-certs\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdxtn\" (UniqueName: \"kubernetes.io/projected/f43c342d-9285-4c06-a913-c094d92a685a-kube-api-access-pdxtn\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414393    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysconfig\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-systemd-units\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-run-netns\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414445    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-multus-certs\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.415370 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5649a67-6272-4146-bf87-46e71b52c59f-tmp\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414465    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-system-cni-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-cnibin\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414502    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-systemd-units\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414514    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-run-netns\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-cni-netd\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df2f33ec-9916-4121-9318-73d89408535c-ovn-node-metrics-cert\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414576    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-cni-netd\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-sys\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-var-lib-kubelet\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj4wq\" (UniqueName: \"kubernetes.io/projected/daa3b874-9544-44c5-8a23-e7d1a8d3893e-kube-api-access-hj4wq\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414695    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-sys\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-systemd\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-os-release\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414738    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97-konnectivity-ca\") pod \"konnectivity-agent-6mbks\" (UID: \"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97\") " pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414748    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-var-lib-kubelet\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-netns\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414790    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-run-systemd\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.416249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414769    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414805    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f43c342d-9285-4c06-a913-c094d92a685a-multus-daemon-config\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414844    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-os-release\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414802    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-run-netns\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414894    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2607803-14a5-4125-939d-8fe7b1e40de0-host\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.414924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97-agent-certs\") pod \"konnectivity-agent-6mbks\" (UID: \"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97\") " pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/daa3b874-9544-44c5-8a23-e7d1a8d3893e-hosts-file\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-slash\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415097    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/daa3b874-9544-44c5-8a23-e7d1a8d3893e-hosts-file\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-host\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415137    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-host\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5649a67-6272-4146-bf87-46e71b52c59f-etc-tuned\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415170    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-slash\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa3b874-9544-44c5-8a23-e7d1a8d3893e-tmp-dir\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-cni-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f43c342d-9285-4c06-a913-c094d92a685a-cni-binary-copy\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-socket-dir-parent\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-log-socket\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-modprobe-d\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysctl-d\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-cnibin\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-cni-bin\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba3f852f-a751-40f8-9751-203da2310fd2-iptables-alerter-script\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-env-overrides\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-systemd\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-system-cni-dir\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-os-release\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbp4\" (UniqueName: \"kubernetes.io/projected/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-kube-api-access-gmbp4\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-cni-multus\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-var-lib-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-cni-bin\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6qh\" (UniqueName: \"kubernetes.io/projected/e5649a67-6272-4146-bf87-46e71b52c59f-kube-api-access-hk6qh\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.417767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwxst\" (UniqueName: \"kubernetes.io/projected/e2607803-14a5-4125-939d-8fe7b1e40de0-kube-api-access-pwxst\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-kubelet-config\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba3f852f-a751-40f8-9751-203da2310fd2-host-slash\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415973    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.415999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgp2\" (UniqueName: \"kubernetes.io/projected/ba3f852f-a751-40f8-9751-203da2310fd2-kube-api-access-rhgp2\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416267    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa3b874-9544-44c5-8a23-e7d1a8d3893e-tmp-dir\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416345    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-cni-multus\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416352    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-cni-dir\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416392    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-var-lib-openvswitch\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416400    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-cnibin\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416420    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-sysctl-d\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416435    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-host-cni-bin\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416439    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-host-var-lib-cni-bin\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416269    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-systemd\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416483    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f43c342d-9285-4c06-a913-c094d92a685a-multus-socket-dir-parent\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416532    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-kubelet-config\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.418495 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.416609    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416682    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba3f852f-a751-40f8-9751-203da2310fd2-host-slash\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.416701    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret podName:f48c9095-444f-4e2f-9f5d-22fbe4305bf3 nodeName:}" failed. No retries permitted until 2026-07-07 11:26:58.91666782 +0000 UTC m=+1.955892513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret") pod "global-pull-secret-syncer-vsp4z" (UID: "f48c9095-444f-4e2f-9f5d-22fbe4305bf3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df2f33ec-9916-4121-9318-73d89408535c-log-socket\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416855    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df2f33ec-9916-4121-9318-73d89408535c-env-overrides\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.416904    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5649a67-6272-4146-bf87-46e71b52c59f-etc-modprobe-d\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.417185    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba3f852f-a751-40f8-9751-203da2310fd2-iptables-alerter-script\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.418118    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f43c342d-9285-4c06-a913-c094d92a685a-cni-binary-copy\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.418218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5649a67-6272-4146-bf87-46e71b52c59f-tmp\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.418310    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5649a67-6272-4146-bf87-46e71b52c59f-etc-tuned\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.418433    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97-agent-certs\") pod \"konnectivity-agent-6mbks\" (UID: \"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97\") " pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.419096 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.418618    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df2f33ec-9916-4121-9318-73d89408535c-ovn-node-metrics-cert\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.422798 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.422305    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:26:58.422798 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.422342    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:26:58.422798 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.422356    2564 projected.go:196] Error preparing data for projected volume kube-api-access-h44bj for pod openshift-network-diagnostics/network-check-target-vj4xk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:26:58.422798 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.422530    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdxtn\" (UniqueName: \"kubernetes.io/projected/f43c342d-9285-4c06-a913-c094d92a685a-kube-api-access-pdxtn\") pod \"multus-sng86\" (UID: \"f43c342d-9285-4c06-a913-c094d92a685a\") " pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.422798 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.422597    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj podName:15efe017-5702-4f72-abf4-bc30f14099b2 nodeName:}" failed. No retries permitted until 2026-07-07 11:26:58.922556277 +0000 UTC m=+1.961780956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h44bj" (UniqueName: "kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj") pod "network-check-target-vj4xk" (UID: "15efe017-5702-4f72-abf4-bc30f14099b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:26:58.423252 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.423231    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj4wq\" (UniqueName: \"kubernetes.io/projected/daa3b874-9544-44c5-8a23-e7d1a8d3893e-kube-api-access-hj4wq\") pod \"node-resolver-hqz5q\" (UID: \"daa3b874-9544-44c5-8a23-e7d1a8d3893e\") " pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.425500 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.424775    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smpp2\" (UniqueName: \"kubernetes.io/projected/df2f33ec-9916-4121-9318-73d89408535c-kube-api-access-smpp2\") pod \"ovnkube-node-rv8qm\" (UID: \"df2f33ec-9916-4121-9318-73d89408535c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.426137 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.426119    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6qh\" (UniqueName: \"kubernetes.io/projected/e5649a67-6272-4146-bf87-46e71b52c59f-kube-api-access-hk6qh\") pod \"tuned-zchhk\" (UID: \"e5649a67-6272-4146-bf87-46e71b52c59f\") " pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.426137 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.426130    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgp2\" (UniqueName: \"kubernetes.io/projected/ba3f852f-a751-40f8-9751-203da2310fd2-kube-api-access-rhgp2\") pod \"iptables-alerter-pxlk5\" (UID: \"ba3f852f-a751-40f8-9751-203da2310fd2\") " pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.487324 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.487279    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc010214d8710e456690b884b961bbc6a.slice/crio-97320a560dabaccb8cac091c90a51add48a4e16f3fab6e514c4e3a43d8a91981 WatchSource:0}: Error finding container 97320a560dabaccb8cac091c90a51add48a4e16f3fab6e514c4e3a43d8a91981: Status 404 returned error can't find the container with id 97320a560dabaccb8cac091c90a51add48a4e16f3fab6e514c4e3a43d8a91981
Jul 07 11:26:58.487987 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.487969    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01502c7c24216826a0dc843b8111a65b.slice/crio-6036f4cd5c89bc86e4844fbf6fb6ac1c7f657f0b832340c1e91c91340c5ec963 WatchSource:0}: Error finding container 6036f4cd5c89bc86e4844fbf6fb6ac1c7f657f0b832340c1e91c91340c5ec963: Status 404 returned error can't find the container with id 6036f4cd5c89bc86e4844fbf6fb6ac1c7f657f0b832340c1e91c91340c5ec963
Jul 07 11:26:58.493144 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.493130    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:26:58.516870 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.516835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-system-cni-dir\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.516870 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.516865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-os-release\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.516870 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.516880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:26:58.517103 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.516930    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-system-cni-dir\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517103 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.516942    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-os-release\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517103 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.516980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbp4\" (UniqueName: \"kubernetes.io/projected/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-kube-api-access-gmbp4\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:26:58.517103 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517103 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwxst\" (UniqueName: \"kubernetes.io/projected/e2607803-14a5-4125-939d-8fe7b1e40de0-kube-api-access-pwxst\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.517254 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.517107    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:26:58.517254 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.517158    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:26:59.017141265 +0000 UTC m=+2.056365943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:26:58.517254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dtj\" (UniqueName: \"kubernetes.io/projected/7761287c-1778-4853-be7c-8a1867dbb173-kube-api-access-72dtj\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517451 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-registration-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517451 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517393    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517451 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-device-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517451 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517444    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-registration-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517473    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-socket-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517517    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-device-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517530    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517547    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nptdm\" (UniqueName: \"kubernetes.io/projected/0bb57178-381c-4286-a6be-77b92d7acde2-kube-api-access-nptdm\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2607803-14a5-4125-939d-8fe7b1e40de0-serviceca\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517643    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-socket-dir\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-sys-fs\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.517665 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517662    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.518068 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-cnibin\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.518068 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517697    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb57178-381c-4286-a6be-77b92d7acde2-sys-fs\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.518068 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517739    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7761287c-1778-4853-be7c-8a1867dbb173-cnibin\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.518068 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2607803-14a5-4125-939d-8fe7b1e40de0-host\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.518068 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517804    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2607803-14a5-4125-939d-8fe7b1e40de0-host\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.518068 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.517936    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2607803-14a5-4125-939d-8fe7b1e40de0-serviceca\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.518068 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.518004    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7761287c-1778-4853-be7c-8a1867dbb173-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.527301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.527276    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nptdm\" (UniqueName: \"kubernetes.io/projected/0bb57178-381c-4286-a6be-77b92d7acde2-kube-api-access-nptdm\") pod \"aws-ebs-csi-driver-node-lnkj6\" (UID: \"0bb57178-381c-4286-a6be-77b92d7acde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.527416 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.527401    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dtj\" (UniqueName: \"kubernetes.io/projected/7761287c-1778-4853-be7c-8a1867dbb173-kube-api-access-72dtj\") pod \"multus-additional-cni-plugins-n4r9t\" (UID: \"7761287c-1778-4853-be7c-8a1867dbb173\") " pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.527578 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.527553    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwxst\" (UniqueName: \"kubernetes.io/projected/e2607803-14a5-4125-939d-8fe7b1e40de0-kube-api-access-pwxst\") pod \"node-ca-89kg2\" (UID: \"e2607803-14a5-4125-939d-8fe7b1e40de0\") " pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.527776 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.527761    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbp4\" (UniqueName: \"kubernetes.io/projected/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-kube-api-access-gmbp4\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:26:58.636768 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.636685    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sng86"
Jul 07 11:26:58.645574 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.645546    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43c342d_9285_4c06_a913_c094d92a685a.slice/crio-021813958cc526efc656dccd5474626a7336db4ac96c9d7491d2db14ea11a3b1 WatchSource:0}: Error finding container 021813958cc526efc656dccd5474626a7336db4ac96c9d7491d2db14ea11a3b1: Status 404 returned error can't find the container with id 021813958cc526efc656dccd5474626a7336db4ac96c9d7491d2db14ea11a3b1
Jul 07 11:26:58.650663 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.650644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pxlk5"
Jul 07 11:26:58.658703 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.658676    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3f852f_a751_40f8_9751_203da2310fd2.slice/crio-0ab756e84b1f99afcd42a9b1bfcbfc37112bab41ba87ac1a2dd5230fe30ab93b WatchSource:0}: Error finding container 0ab756e84b1f99afcd42a9b1bfcbfc37112bab41ba87ac1a2dd5230fe30ab93b: Status 404 returned error can't find the container with id 0ab756e84b1f99afcd42a9b1bfcbfc37112bab41ba87ac1a2dd5230fe30ab93b
Jul 07 11:26:58.667734 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.667710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:26:58.675931 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.675900    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2f33ec_9916_4121_9318_73d89408535c.slice/crio-055147ddd68428842d06c820be81cd6b57334b08b149a03c5016b47bdce382b8 WatchSource:0}: Error finding container 055147ddd68428842d06c820be81cd6b57334b08b149a03c5016b47bdce382b8: Status 404 returned error can't find the container with id 055147ddd68428842d06c820be81cd6b57334b08b149a03c5016b47bdce382b8
Jul 07 11:26:58.682142 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.682120    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:26:58.690090 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.690057    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcd27f4_fb84_4ca8_b2dd_6b7ac1e67e97.slice/crio-77a51343dc8882288f6b2c7d86e9d15a88cc0f2d12577bca9988a73443558b9f WatchSource:0}: Error finding container 77a51343dc8882288f6b2c7d86e9d15a88cc0f2d12577bca9988a73443558b9f: Status 404 returned error can't find the container with id 77a51343dc8882288f6b2c7d86e9d15a88cc0f2d12577bca9988a73443558b9f
Jul 07 11:26:58.697550 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.697525    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zchhk"
Jul 07 11:26:58.705691 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.705664    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5649a67_6272_4146_bf87_46e71b52c59f.slice/crio-5469a63640953dda6d49166a4fb8d3aca3d4f115e2805c65558fb92b8212b9c2 WatchSource:0}: Error finding container 5469a63640953dda6d49166a4fb8d3aca3d4f115e2805c65558fb92b8212b9c2: Status 404 returned error can't find the container with id 5469a63640953dda6d49166a4fb8d3aca3d4f115e2805c65558fb92b8212b9c2
Jul 07 11:26:58.712257 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.712234    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hqz5q"
Jul 07 11:26:58.719215 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.719190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-89kg2"
Jul 07 11:26:58.720820 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.720788    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa3b874_9544_44c5_8a23_e7d1a8d3893e.slice/crio-8dabb50bc112e5810833a167d38459371dee0d62768262399525712b29f6ec10 WatchSource:0}: Error finding container 8dabb50bc112e5810833a167d38459371dee0d62768262399525712b29f6ec10: Status 404 returned error can't find the container with id 8dabb50bc112e5810833a167d38459371dee0d62768262399525712b29f6ec10
Jul 07 11:26:58.758691 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.758651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n4r9t"
Jul 07 11:26:58.763595 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.763573    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6"
Jul 07 11:26:58.767964 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.767942    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7761287c_1778_4853_be7c_8a1867dbb173.slice/crio-4640298dc6243ea6ed77fcddab052ccf85a124c3f6c8c34010387e055a8600cf WatchSource:0}: Error finding container 4640298dc6243ea6ed77fcddab052ccf85a124c3f6c8c34010387e055a8600cf: Status 404 returned error can't find the container with id 4640298dc6243ea6ed77fcddab052ccf85a124c3f6c8c34010387e055a8600cf
Jul 07 11:26:58.772274 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:26:58.772252    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb57178_381c_4286_a6be_77b92d7acde2.slice/crio-90592619ea4b1c1a5f560588e9f04a73c345d27e9708ab6cfea06e7cead92022 WatchSource:0}: Error finding container 90592619ea4b1c1a5f560588e9f04a73c345d27e9708ab6cfea06e7cead92022: Status 404 returned error can't find the container with id 90592619ea4b1c1a5f560588e9f04a73c345d27e9708ab6cfea06e7cead92022
Jul 07 11:26:58.920851 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:58.920766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:58.921010 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.920923    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:26:58.921010 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:58.920982    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret podName:f48c9095-444f-4e2f-9f5d-22fbe4305bf3 nodeName:}" failed. No retries permitted until 2026-07-07 11:26:59.920966288 +0000 UTC m=+2.960190971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret") pod "global-pull-secret-syncer-vsp4z" (UID: "f48c9095-444f-4e2f-9f5d-22fbe4305bf3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:26:59.021581 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.021547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:26:59.021771 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.021659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:26:59.021837 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.021789    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:26:59.021837 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.021809    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:26:59.021837 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.021820    2564 projected.go:196] Error preparing data for projected volume kube-api-access-h44bj for pod openshift-network-diagnostics/network-check-target-vj4xk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:26:59.021982 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.021870    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj podName:15efe017-5702-4f72-abf4-bc30f14099b2 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:00.021854719 +0000 UTC m=+3.061079401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h44bj" (UniqueName: "kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj") pod "network-check-target-vj4xk" (UID: "15efe017-5702-4f72-abf4-bc30f14099b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:26:59.022250 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.022230    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:26:59.022331 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.022274    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:00.02226099 +0000 UTC m=+3.061485670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:26:59.349319 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.349173    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 11:21:57 +0000 UTC" deadline="2028-04-15 01:33:02.595833972 +0000 UTC"
Jul 07 11:26:59.349319 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.349225    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15542h6m3.24661253s"
Jul 07 11:26:59.375225 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.374970    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:26:59.453456 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.453396    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6" event={"ID":"0bb57178-381c-4286-a6be-77b92d7acde2","Type":"ContainerStarted","Data":"90592619ea4b1c1a5f560588e9f04a73c345d27e9708ab6cfea06e7cead92022"}
Jul 07 11:26:59.469719 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.469671    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerStarted","Data":"4640298dc6243ea6ed77fcddab052ccf85a124c3f6c8c34010387e055a8600cf"}
Jul 07 11:26:59.481953 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.481913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-89kg2" event={"ID":"e2607803-14a5-4125-939d-8fe7b1e40de0","Type":"ContainerStarted","Data":"2b68209f8ec150844fc1bd2e41c7ab105b6cc603cfac745d5454f35101912d49"}
Jul 07 11:26:59.485685 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.485645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zchhk" event={"ID":"e5649a67-6272-4146-bf87-46e71b52c59f","Type":"ContainerStarted","Data":"5469a63640953dda6d49166a4fb8d3aca3d4f115e2805c65558fb92b8212b9c2"}
Jul 07 11:26:59.493514 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.493476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sng86" event={"ID":"f43c342d-9285-4c06-a913-c094d92a685a","Type":"ContainerStarted","Data":"021813958cc526efc656dccd5474626a7336db4ac96c9d7491d2db14ea11a3b1"}
Jul 07 11:26:59.503163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.503122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"01502c7c24216826a0dc843b8111a65b","Type":"ContainerStarted","Data":"6036f4cd5c89bc86e4844fbf6fb6ac1c7f657f0b832340c1e91c91340c5ec963"}
Jul 07 11:26:59.520062 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.520022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hqz5q" event={"ID":"daa3b874-9544-44c5-8a23-e7d1a8d3893e","Type":"ContainerStarted","Data":"8dabb50bc112e5810833a167d38459371dee0d62768262399525712b29f6ec10"}
Jul 07 11:26:59.536472 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.536435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6mbks" event={"ID":"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97","Type":"ContainerStarted","Data":"77a51343dc8882288f6b2c7d86e9d15a88cc0f2d12577bca9988a73443558b9f"}
Jul 07 11:26:59.555430 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.555391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"055147ddd68428842d06c820be81cd6b57334b08b149a03c5016b47bdce382b8"}
Jul 07 11:26:59.566788 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.566748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pxlk5" event={"ID":"ba3f852f-a751-40f8-9751-203da2310fd2","Type":"ContainerStarted","Data":"0ab756e84b1f99afcd42a9b1bfcbfc37112bab41ba87ac1a2dd5230fe30ab93b"}
Jul 07 11:26:59.584270 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.583883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"c010214d8710e456690b884b961bbc6a","Type":"ContainerStarted","Data":"97320a560dabaccb8cac091c90a51add48a4e16f3fab6e514c4e3a43d8a91981"}
Jul 07 11:26:59.927074 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:26:59.927028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:26:59.927248 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.927190    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:26:59.927359 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:26:59.927250    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret podName:f48c9095-444f-4e2f-9f5d-22fbe4305bf3 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:01.927234011 +0000 UTC m=+4.966458695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret") pod "global-pull-secret-syncer-vsp4z" (UID: "f48c9095-444f-4e2f-9f5d-22fbe4305bf3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:00.028108 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.028060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:00.028108 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.028114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:00.028324 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.028221    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:00.028324 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.028277    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:02.028260237 +0000 UTC m=+5.067484920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:00.028428 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.028371    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:27:00.028428 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.028384    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:27:00.028428 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.028396    2564 projected.go:196] Error preparing data for projected volume kube-api-access-h44bj for pod openshift-network-diagnostics/network-check-target-vj4xk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:00.028568 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.028430    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj podName:15efe017-5702-4f72-abf4-bc30f14099b2 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:02.028418467 +0000 UTC m=+5.067643147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h44bj" (UniqueName: "kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj") pod "network-check-target-vj4xk" (UID: "15efe017-5702-4f72-abf4-bc30f14099b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:00.325202 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.325126    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:27:00.349892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.349851    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 11:21:57 +0000 UTC" deadline="2028-03-13 05:13:45.749375547 +0000 UTC"
Jul 07 11:27:00.349892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.349891    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14753h46m45.399489281s"
Jul 07 11:27:00.412186 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.411956    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:00.412420 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.412298    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:00.412711 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.412694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:00.412830 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.412785    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:00.412893 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.412843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:00.412937 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:00.412906    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:00.781907 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:00.781832    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:27:01.944206 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:01.944062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:01.944206 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:01.944171    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:01.944741 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:01.944232    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret podName:f48c9095-444f-4e2f-9f5d-22fbe4305bf3 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:05.944216783 +0000 UTC m=+8.983441461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret") pod "global-pull-secret-syncer-vsp4z" (UID: "f48c9095-444f-4e2f-9f5d-22fbe4305bf3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:02.044695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:02.044653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:02.044869 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:02.044714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:02.044869 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.044853    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:02.044980 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.044908    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:06.044891828 +0000 UTC m=+9.084116506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:02.045251 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.045227    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:27:02.045251 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.045253    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:27:02.045414 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.045266    2564 projected.go:196] Error preparing data for projected volume kube-api-access-h44bj for pod openshift-network-diagnostics/network-check-target-vj4xk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:02.045414 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.045306    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj podName:15efe017-5702-4f72-abf4-bc30f14099b2 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:06.045293292 +0000 UTC m=+9.084517975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h44bj" (UniqueName: "kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj") pod "network-check-target-vj4xk" (UID: "15efe017-5702-4f72-abf4-bc30f14099b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:02.412327 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:02.412238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:02.412497 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.412374    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:02.412741 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:02.412722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:02.412867 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.412840    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:02.412940 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:02.412722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:02.412996 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:02.412945    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:04.412959 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:04.412432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:04.412959 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:04.412462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:04.412959 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:04.412462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:04.412959 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:04.412598    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:04.412959 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:04.412685    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:04.412959 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:04.412757    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:05.976540 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:05.976502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:05.977036 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:05.976696    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:05.977036 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:05.976762    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret podName:f48c9095-444f-4e2f-9f5d-22fbe4305bf3 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:13.97674226 +0000 UTC m=+17.015966955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret") pod "global-pull-secret-syncer-vsp4z" (UID: "f48c9095-444f-4e2f-9f5d-22fbe4305bf3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:06.077418 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:06.077376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:06.077603 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:06.077485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:06.077695 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.077678    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:06.077695 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.077681    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:27:06.077801 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.077705    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:27:06.077801 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.077717    2564 projected.go:196] Error preparing data for projected volume kube-api-access-h44bj for pod openshift-network-diagnostics/network-check-target-vj4xk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:06.077801 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.077747    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:14.077727697 +0000 UTC m=+17.116952378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:06.077801 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.077763    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj podName:15efe017-5702-4f72-abf4-bc30f14099b2 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:14.077755051 +0000 UTC m=+17.116979731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h44bj" (UniqueName: "kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj") pod "network-check-target-vj4xk" (UID: "15efe017-5702-4f72-abf4-bc30f14099b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:06.413512 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:06.412601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:06.413512 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.412767    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:06.413512 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:06.413161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:06.413512 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.413259    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:06.413512 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:06.413311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:06.413512 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:06.413389    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:08.412652 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:08.412545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:08.412652 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:08.412558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:08.413121 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:08.412704    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:08.413121 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:08.412765    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:08.413121 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:08.412558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:08.413121 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:08.412854    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:10.412703 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:10.412652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:10.412703 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:10.412685    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:10.413180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:10.412668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:10.413180 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:10.412836    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:10.413180 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:10.412945    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:10.413180 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:10.413044    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:12.412245 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:12.412205    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:12.412666 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:12.412209    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:12.412666 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:12.412321    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:12.412666 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:12.412220    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:12.412666 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:12.412417    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:12.412666 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:12.412523    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:14.041197 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:14.041159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:14.041724 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.041339    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:14.041724 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.041405    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret podName:f48c9095-444f-4e2f-9f5d-22fbe4305bf3 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:30.0413881 +0000 UTC m=+33.080612783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret") pod "global-pull-secret-syncer-vsp4z" (UID: "f48c9095-444f-4e2f-9f5d-22fbe4305bf3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:14.141765 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:14.141719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:14.141985 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:14.141791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:14.141985 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.141926    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:14.141985 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.141926    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:27:14.141985 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.141957    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:27:14.141985 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.141971    2564 projected.go:196] Error preparing data for projected volume kube-api-access-h44bj for pod openshift-network-diagnostics/network-check-target-vj4xk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:14.141985 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.141979    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:30.141965215 +0000 UTC m=+33.181189894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:14.142264 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.142022    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj podName:15efe017-5702-4f72-abf4-bc30f14099b2 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:30.142005569 +0000 UTC m=+33.181230249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h44bj" (UniqueName: "kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj") pod "network-check-target-vj4xk" (UID: "15efe017-5702-4f72-abf4-bc30f14099b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:14.412460 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:14.412353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:14.412729 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:14.412467    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:14.412729 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.412479    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:14.412729 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:14.412479    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:14.412729 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.412559    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:14.412729 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:14.412667    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:16.412099 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:16.412057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:16.412555 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:16.412057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:16.412555 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:16.412202    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:16.412555 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:16.412057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:16.412555 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:16.412255    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:16.412555 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:16.412364    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:18.412165 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:18.412134    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:18.412624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:18.412185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:18.412624 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:18.412256    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:18.412624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:18.412574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:18.412791 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:18.412674    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:18.412791 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:18.412727    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:19.631081 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.630880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zchhk" event={"ID":"e5649a67-6272-4146-bf87-46e71b52c59f","Type":"ContainerStarted","Data":"bdbd88a738cfc2391f6159aa3272a0a37b32549f48c9f616e36dbc571f39460e"}
Jul 07 11:27:19.632839 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.632811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sng86" event={"ID":"f43c342d-9285-4c06-a913-c094d92a685a","Type":"ContainerStarted","Data":"7d5d53140e64565375cd03f72f7a9060a40eec05039d6d857f956ac14d97e9ec"}
Jul 07 11:27:19.634189 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.634165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"01502c7c24216826a0dc843b8111a65b","Type":"ContainerStarted","Data":"60065b3e659f0b61b5288c3ea215e6c62a74de908eb781c0034274433689afa7"}
Jul 07 11:27:19.636512 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.636489    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:27:19.636862 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.636841    2564 generic.go:356] "Generic (PLEG): container finished" podID="df2f33ec-9916-4121-9318-73d89408535c" containerID="2934206c050ea70d6701cc336e6f85b759fdae0d8b52e819a37007f4192879f8" exitCode=1
Jul 07 11:27:19.636916 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.636877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"829782a8e3781d172751407ffd1edc6aa9496ebde644e778abeb5061c9b38592"}
Jul 07 11:27:19.636958 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.636922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"afdd48ff8038f2ccc1b325d701e0aae366250b13993861f90726f73ad8bd3028"}
Jul 07 11:27:19.636958 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.636952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"6c0c37db7be77733eb15510ff6135a6e0940f7f0ab96d590a684893805dd1420"}
Jul 07 11:27:19.637022 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.636981    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerDied","Data":"2934206c050ea70d6701cc336e6f85b759fdae0d8b52e819a37007f4192879f8"}
Jul 07 11:27:19.637022 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.637009    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"b2aac488e67f1ccf106a11a6333e3ce958b6e272270933a06868b96e949a82b9"}
Jul 07 11:27:19.653696 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.653651    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zchhk" podStartSLOduration=2.55242837 podStartE2EDuration="22.653617107s" totalImagesPullingTime="20.101188737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:19.652611317 +0000 UTC m=+22.691836029" watchObservedRunningTime="2026-07-07 11:27:19.653617107 +0000 UTC m=+22.692841807"
Jul 07 11:27:19.683760 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.683707    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sng86" podStartSLOduration=2.0192083 podStartE2EDuration="22.683690589s" totalImagesPullingTime="20.664482289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:19.683617337 +0000 UTC m=+22.722842052" watchObservedRunningTime="2026-07-07 11:27:19.683690589 +0000 UTC m=+22.722915290"
Jul 07 11:27:19.684036 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:19.684016    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" podStartSLOduration=22.684010001 podStartE2EDuration="22.684010001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:19.665454362 +0000 UTC m=+22.704679063" watchObservedRunningTime="2026-07-07 11:27:19.684010001 +0000 UTC m=+22.723234704"
Jul 07 11:27:20.412254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.412041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:20.412422 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.412096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:20.412422 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:20.412342    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:20.412422 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:20.412391    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:20.412422 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.412100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:20.412549 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:20.412482    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:20.640129 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.640035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hqz5q" event={"ID":"daa3b874-9544-44c5-8a23-e7d1a8d3893e","Type":"ContainerStarted","Data":"5f7ef2dd129d32eaf44c6454207ffe48442e83d70839f177e56d314e45d06954"}
Jul 07 11:27:20.641580 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.641553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6mbks" event={"ID":"fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97","Type":"ContainerStarted","Data":"fb7b9d0b7dfc51900e2b102b38c930bff66a93dcab0c9f12a02e3bc2a15f48b7"}
Jul 07 11:27:20.644393 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.644366    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:27:20.644802 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.644771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"72dc7bd282c92828a5672591b18656443b0c371ba83e54fbccbcc0305fa32273"}
Jul 07 11:27:20.646494 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.646465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pxlk5" event={"ID":"ba3f852f-a751-40f8-9751-203da2310fd2","Type":"ContainerStarted","Data":"390e771040b49d8053c37c465fd5b9548de0e6f73eebb17458021821bca83601"}
Jul 07 11:27:20.648280 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.648255    2564 generic.go:356] "Generic (PLEG): container finished" podID="c010214d8710e456690b884b961bbc6a" containerID="3144c2d534099d1196e991a740c6f5e8d7eccedd6a974c4a47055cb1a03732cc" exitCode=0
Jul 07 11:27:20.648476 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.648448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"c010214d8710e456690b884b961bbc6a","Type":"ContainerDied","Data":"3144c2d534099d1196e991a740c6f5e8d7eccedd6a974c4a47055cb1a03732cc"}
Jul 07 11:27:20.651432 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.650330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6" event={"ID":"0bb57178-381c-4286-a6be-77b92d7acde2","Type":"ContainerStarted","Data":"4a392d25a2e3c61e879bfea4ff25f895915394a79f77c7b80412d79795bf9069"}
Jul 07 11:27:20.652480 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.652455    2564 generic.go:356] "Generic (PLEG): container finished" podID="7761287c-1778-4853-be7c-8a1867dbb173" containerID="ea568ac53206d46b3ceabaec9c341b1900a375354b17fcc66a388697000dcf50" exitCode=0
Jul 07 11:27:20.652609 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.652542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerDied","Data":"ea568ac53206d46b3ceabaec9c341b1900a375354b17fcc66a388697000dcf50"}
Jul 07 11:27:20.654259 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.654231    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-89kg2" event={"ID":"e2607803-14a5-4125-939d-8fe7b1e40de0","Type":"ContainerStarted","Data":"292cc745f12c1f80fa96e3a77fbfb5fc297da988e23fe571613aa3ef532ab63d"}
Jul 07 11:27:20.674951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.674898    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pxlk5" podStartSLOduration=3.632493414 podStartE2EDuration="23.674880972s" totalImagesPullingTime="20.042387558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:20.674726255 +0000 UTC m=+23.713950958" watchObservedRunningTime="2026-07-07 11:27:20.674880972 +0000 UTC m=+23.714105673"
Jul 07 11:27:20.675288 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.675263    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hqz5q" podStartSLOduration=3.621879153 podStartE2EDuration="23.675253681s" totalImagesPullingTime="20.053374528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:20.66021131 +0000 UTC m=+23.699436011" watchObservedRunningTime="2026-07-07 11:27:20.675253681 +0000 UTC m=+23.714478382"
Jul 07 11:27:20.706873 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.706810    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6mbks" podStartSLOduration=3.588866819 podStartE2EDuration="23.706778866s" totalImagesPullingTime="20.117912047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:20.706135488 +0000 UTC m=+23.745360210" watchObservedRunningTime="2026-07-07 11:27:20.706778866 +0000 UTC m=+23.746003570"
Jul 07 11:27:20.720711 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:20.720666    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-89kg2" podStartSLOduration=3.7021615199999998 podStartE2EDuration="23.720647699s" totalImagesPullingTime="20.018486179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:20.719850733 +0000 UTC m=+23.759075462" watchObservedRunningTime="2026-07-07 11:27:20.720647699 +0000 UTC m=+23.759872392"
Jul 07 11:27:21.350328 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:21.350301    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 11:27:21.399446 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:21.399330    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T11:27:21.350324389Z","UUID":"62caf5d9-05ca-452d-bcd4-2ec8789e4a07","Handler":null,"Name":"","Endpoint":""}
Jul 07 11:27:21.402025 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:21.402002    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 11:27:21.402185 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:21.402049    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 11:27:21.659097 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:21.658965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"c010214d8710e456690b884b961bbc6a","Type":"ContainerStarted","Data":"4e87610a936bcba973ca89dd1bbb96410e298fffe1d7d1e10e63789ec72e85b9"}
Jul 07 11:27:21.661112 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:21.661084    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6" event={"ID":"0bb57178-381c-4286-a6be-77b92d7acde2","Type":"ContainerStarted","Data":"a3e8ca423ab70dcf16714f020649e47cd802862b8911a39301c6254fca257b76"}
Jul 07 11:27:22.412198 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.412164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:22.412198 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.412194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:22.412444 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.412206    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:22.412444 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:22.412293    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:22.412444 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:22.412430    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:22.412606 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:22.412519    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:22.667420 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.667190    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:27:22.667912 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.667886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"0053a6eef1eaa2666cd780ccb3fe8f31a3791697c513e74c0e837f620db1bd49"}
Jul 07 11:27:22.670339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.670306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6" event={"ID":"0bb57178-381c-4286-a6be-77b92d7acde2","Type":"ContainerStarted","Data":"ad5a820fa77aa7c068c34d6a62ceec78838237f2005bc65c835bd808c4b278ea"}
Jul 07 11:27:22.689086 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.689034    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lnkj6" podStartSLOduration=3.494461057 podStartE2EDuration="25.689018448s" totalImagesPullingTime="22.194557391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:22.688993107 +0000 UTC m=+25.728217810" watchObservedRunningTime="2026-07-07 11:27:22.689018448 +0000 UTC m=+25.728243127"
Jul 07 11:27:22.689272 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:22.689185    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" podStartSLOduration=25.689177601 podStartE2EDuration="25.689177601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:21.674555325 +0000 UTC m=+24.713780025" watchObservedRunningTime="2026-07-07 11:27:22.689177601 +0000 UTC m=+25.728402304"
Jul 07 11:27:24.411965 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:24.411879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:24.411965 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:24.411905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:24.411965 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:24.411905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:24.412597 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:24.412010    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:24.412597 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:24.412112    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:24.412597 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:24.412190    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:25.288543 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.288518    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:27:25.289179 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.289160    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:27:25.679692 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.679407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerStarted","Data":"1f976fb6a062b867564ab53c65558425b12568db3f06a927ee4a98d899fb5c2f"}
Jul 07 11:27:25.682726 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.682705    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:27:25.683070 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.683043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"ee553054df0505d28cb92541b2f97517b6982f0a6a65f765fa44a6bd5fce63d8"}
Jul 07 11:27:25.683316 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.683271    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:27:25.683529 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.683512    2564 scope.go:117] "RemoveContainer" containerID="2934206c050ea70d6701cc336e6f85b759fdae0d8b52e819a37007f4192879f8"
Jul 07 11:27:25.683731 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:25.683713    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6mbks"
Jul 07 11:27:26.412578 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.412537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:26.412879 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.412684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:26.412879 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.412713    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:26.412879 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:26.412702    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:26.412879 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:26.412778    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:26.412879 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:26.412858    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:26.687617 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.687585    2564 generic.go:356] "Generic (PLEG): container finished" podID="7761287c-1778-4853-be7c-8a1867dbb173" containerID="1f976fb6a062b867564ab53c65558425b12568db3f06a927ee4a98d899fb5c2f" exitCode=0
Jul 07 11:27:26.688149 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.687709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerDied","Data":"1f976fb6a062b867564ab53c65558425b12568db3f06a927ee4a98d899fb5c2f"}
Jul 07 11:27:26.692067 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.692048    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:27:26.692484 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.692451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" event={"ID":"df2f33ec-9916-4121-9318-73d89408535c","Type":"ContainerStarted","Data":"bfa79d48c47eec7ee567e935d4ee7c894013ae26f8e357cb37cb782cbe72ce93"}
Jul 07 11:27:26.693898 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.692779    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:27:26.693898 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.692899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:27:26.693898 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.692958    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:27:26.709897 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.709871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:27:26.710546 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.710528    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:27:26.741899 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:26.741796    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm" podStartSLOduration=9.567643136000001 podStartE2EDuration="29.741778801s" totalImagesPullingTime="20.174135665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:26.741152482 +0000 UTC m=+29.780377194" watchObservedRunningTime="2026-07-07 11:27:26.741778801 +0000 UTC m=+29.781003501"
Jul 07 11:27:27.219950 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:27.219914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s5js2"]
Jul 07 11:27:27.220115 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:27.220052    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:27.220169 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:27.220140    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:27.224005 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:27.223975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vsp4z"]
Jul 07 11:27:27.224167 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:27.224113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:27.224277 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:27.224254    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:27.224599 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:27.224581    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vj4xk"]
Jul 07 11:27:27.224716 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:27.224700    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:27.224820 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:27.224799    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:28.698512 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:28.698477    2564 generic.go:356] "Generic (PLEG): container finished" podID="7761287c-1778-4853-be7c-8a1867dbb173" containerID="2b618fbad28d1cfa9dea104959644a6b6894e2e7024c3f150cbcc3c2cd91e939" exitCode=0
Jul 07 11:27:28.699067 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:28.698564    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerDied","Data":"2b618fbad28d1cfa9dea104959644a6b6894e2e7024c3f150cbcc3c2cd91e939"}
Jul 07 11:27:29.307682 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:29.307649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:29.407826 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:29.407785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:29.411734 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:29.411708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:29.411734 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:29.411718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:29.411948 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:29.411718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:29.411948 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:29.411806    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:29.411948 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:29.411870    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:29.412099 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:29.411945    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:30.059940 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:30.059903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:30.060314 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.060021    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:30.060314 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.060076    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret podName:f48c9095-444f-4e2f-9f5d-22fbe4305bf3 nodeName:}" failed. No retries permitted until 2026-07-07 11:28:02.060061861 +0000 UTC m=+65.099286541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret") pod "global-pull-secret-syncer-vsp4z" (UID: "f48c9095-444f-4e2f-9f5d-22fbe4305bf3") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:27:30.161076 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:30.161040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:30.161256 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:30.161129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:30.161256 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.161219    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:30.161256 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.161245    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:27:30.161394 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.161261    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:27:30.161394 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.161274    2564 projected.go:196] Error preparing data for projected volume kube-api-access-h44bj for pod openshift-network-diagnostics/network-check-target-vj4xk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:30.161394 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.161294    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:28:02.161276124 +0000 UTC m=+65.200500803 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:27:30.161394 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:30.161324    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj podName:15efe017-5702-4f72-abf4-bc30f14099b2 nodeName:}" failed. No retries permitted until 2026-07-07 11:28:02.161309023 +0000 UTC m=+65.200533718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h44bj" (UniqueName: "kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj") pod "network-check-target-vj4xk" (UID: "15efe017-5702-4f72-abf4-bc30f14099b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:27:30.705219 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:30.705176    2564 generic.go:356] "Generic (PLEG): container finished" podID="7761287c-1778-4853-be7c-8a1867dbb173" containerID="d77cebd256708ed5bdd08f87aa68c37aeb77d0c021cd03947604733746e2d867" exitCode=0
Jul 07 11:27:30.705369 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:30.705245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerDied","Data":"d77cebd256708ed5bdd08f87aa68c37aeb77d0c021cd03947604733746e2d867"}
Jul 07 11:27:31.412522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.412485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:31.413161 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.412485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:31.413161 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:31.412651    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:27:31.413161 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:31.412802    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsp4z" podUID="f48c9095-444f-4e2f-9f5d-22fbe4305bf3"
Jul 07 11:27:31.413161 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.412485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:31.413161 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:31.412873    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vj4xk" podUID="15efe017-5702-4f72-abf4-bc30f14099b2"
Jul 07 11:27:31.833859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.833828    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeReady"
Jul 07 11:27:31.834113 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.833996    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 11:27:31.867663 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.867195    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f86dc9889-ss6pj"]
Jul 07 11:27:31.885943 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.885910    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dkzfh"]
Jul 07 11:27:31.886122 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.886023    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.888619 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.888594    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 11:27:31.888981 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.888962    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 11:27:31.889260 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.889243    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7m7fm\""
Jul 07 11:27:31.889622 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.889598    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 11:27:31.895619 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.895600    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 11:27:31.906049 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.906019    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7tt9g"]
Jul 07 11:27:31.906184 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.906107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:31.909037 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.909014    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 11:27:31.909154 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.909041    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xqnk4\""
Jul 07 11:27:31.909314 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.909294    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 11:27:31.930088 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.930047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f86dc9889-ss6pj"]
Jul 07 11:27:31.930088 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.930093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dkzfh"]
Jul 07 11:27:31.930312 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.930122    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7tt9g"]
Jul 07 11:27:31.930312 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.930173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:31.933578 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.933551    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 11:27:31.933747 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.933552    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7kkm5\""
Jul 07 11:27:31.933804 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.933764    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 11:27:31.933917 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.933903    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 11:27:31.972947 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.972864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:31.972947 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.972918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.973132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.972959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-certificates\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.973132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.972984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g6n9\" (UniqueName: \"kubernetes.io/projected/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-kube-api-access-8g6n9\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:31.973132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da091e3f-541c-4b76-9da4-0ddb4085005f-ca-trust-extracted\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.973132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-trusted-ca\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.973132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-bound-sa-token\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.973132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-config-volume\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:31.973405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6c5v\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-kube-api-access-f6c5v\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.973405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-installation-pull-secrets\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:31.973405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-tmp-dir\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:31.973405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:31.973333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-image-registry-private-configuration\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074167 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.074326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-certificates\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g6n9\" (UniqueName: \"kubernetes.io/projected/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-kube-api-access-8g6n9\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.074326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da091e3f-541c-4b76-9da4-0ddb4085005f-ca-trust-extracted\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-trusted-ca\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-bound-sa-token\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074326 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.074316    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-config-volume\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.074342    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.074367    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.074382    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:32.574363113 +0000 UTC m=+35.613587792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nshj2\" (UniqueName: \"kubernetes.io/projected/2a5cb523-1c88-4b56-86c5-cb4a22987c5e-kube-api-access-nshj2\") pod \"ingress-canary-7tt9g\" (UID: \"2a5cb523-1c88-4b56-86c5-cb4a22987c5e\") " pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.074421    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:27:32.57440387 +0000 UTC m=+35.613628554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6c5v\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-kube-api-access-f6c5v\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-installation-pull-secrets\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074529    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a5cb523-1c88-4b56-86c5-cb4a22987c5e-cert\") pod \"ingress-canary-7tt9g\" (UID: \"2a5cb523-1c88-4b56-86c5-cb4a22987c5e\") " pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-tmp-dir\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.074695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.074582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-image-registry-private-configuration\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.075218 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.075039    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-config-volume\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.075309 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.075277    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-tmp-dir\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.075439 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.075326    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da091e3f-541c-4b76-9da4-0ddb4085005f-ca-trust-extracted\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.075439 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.075356    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-certificates\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.075649 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.075602    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-trusted-ca\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.079483 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.079459    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-image-registry-private-configuration\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.079617 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.079596    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-installation-pull-secrets\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.083738 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.083489    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g6n9\" (UniqueName: \"kubernetes.io/projected/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-kube-api-access-8g6n9\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.083738 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.083564    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6c5v\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-kube-api-access-f6c5v\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.083738 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.083702    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-bound-sa-token\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.136754 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.136722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:32.175649 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.175585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a5cb523-1c88-4b56-86c5-cb4a22987c5e-cert\") pod \"ingress-canary-7tt9g\" (UID: \"2a5cb523-1c88-4b56-86c5-cb4a22987c5e\") " pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:32.175861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.175843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nshj2\" (UniqueName: \"kubernetes.io/projected/2a5cb523-1c88-4b56-86c5-cb4a22987c5e-kube-api-access-nshj2\") pod \"ingress-canary-7tt9g\" (UID: \"2a5cb523-1c88-4b56-86c5-cb4a22987c5e\") " pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:32.179005 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.178981    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a5cb523-1c88-4b56-86c5-cb4a22987c5e-cert\") pod \"ingress-canary-7tt9g\" (UID: \"2a5cb523-1c88-4b56-86c5-cb4a22987c5e\") " pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:32.185426 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.185390    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nshj2\" (UniqueName: \"kubernetes.io/projected/2a5cb523-1c88-4b56-86c5-cb4a22987c5e-kube-api-access-nshj2\") pod \"ingress-canary-7tt9g\" (UID: \"2a5cb523-1c88-4b56-86c5-cb4a22987c5e\") " pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:32.240757 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.240622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7tt9g"
Jul 07 11:27:32.454215 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.454187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7tt9g"]
Jul 07 11:27:32.579999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.579897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:32.579999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.579955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:32.580205 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.580068    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:27:32.580205 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.580121    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:27:32.580205 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.580133    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:27:32.580205 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.580141    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:33.580121378 +0000 UTC m=+36.619346062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:27:32.580205 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:32.580178    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:27:33.580162063 +0000 UTC m=+36.619386743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:27:32.711981 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:32.711942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7tt9g" event={"ID":"2a5cb523-1c88-4b56-86c5-cb4a22987c5e","Type":"ContainerStarted","Data":"60268dcb97906c682836e00e7fb388087f90381f43f0c7c75af23ac948bc4100"}
Jul 07 11:27:33.412151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.412115    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:27:33.412732 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.412704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:27:33.412918 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.412897    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:27:33.415728 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.415706    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 11:27:33.416888 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.416866    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 11:27:33.417165 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.417145    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xcgtk\""
Jul 07 11:27:33.417244 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.417218    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfmsb\""
Jul 07 11:27:33.417310 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.417154    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 11:27:33.417461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.417443    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 11:27:33.588540 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.588503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:33.589048 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:33.588554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:33.589048 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:33.588696    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:27:33.589048 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:33.588714    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:27:33.589048 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:33.588729    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:27:33.589048 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:33.588769    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:35.588746732 +0000 UTC m=+38.627971425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:27:33.589048 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:33.588788    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:27:35.588778809 +0000 UTC m=+38.628003495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:27:34.308059 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:34.308024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:34.375163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:34.375128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:35.608536 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:35.608498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:35.608990 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:35.608549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:35.608990 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:35.608696    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:27:35.608990 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:35.608760    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:39.608739852 +0000 UTC m=+42.647964531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:27:35.608990 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:35.608763    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:27:35.608990 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:35.608784    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:27:35.608990 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:35.608837    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:27:39.608819937 +0000 UTC m=+42.648044617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:27:36.318389 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:36.318353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:36.418458 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:36.418426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:36.724922 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:36.724886    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerStarted","Data":"0460d8a6b8ee25c5aa308beec7b0b1a6498b65765ffecd5f124d814c1ff4db9e"}
Jul 07 11:27:37.341933 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:37.341891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:37.729594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:37.729558    2564 generic.go:356] "Generic (PLEG): container finished" podID="7761287c-1778-4853-be7c-8a1867dbb173" containerID="0460d8a6b8ee25c5aa308beec7b0b1a6498b65765ffecd5f124d814c1ff4db9e" exitCode=0
Jul 07 11:27:37.730223 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:37.729663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerDied","Data":"0460d8a6b8ee25c5aa308beec7b0b1a6498b65765ffecd5f124d814c1ff4db9e"}
Jul 07 11:27:37.731165 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:37.731144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7tt9g" event={"ID":"2a5cb523-1c88-4b56-86c5-cb4a22987c5e","Type":"ContainerStarted","Data":"9e11da59d4db39d7168276cd2202741247dff5176e97810b9cb7219bb5308014"}
Jul 07 11:27:37.769510 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:37.769453    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7tt9g" podStartSLOduration=2.644780335 podStartE2EDuration="6.769427414s" totalImagesPullingTime="4.124647079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:37.768215795 +0000 UTC m=+40.807440498" watchObservedRunningTime="2026-07-07 11:27:37.769427414 +0000 UTC m=+40.808652117"
Jul 07 11:27:38.736572 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:38.736529    2564 generic.go:356] "Generic (PLEG): container finished" podID="7761287c-1778-4853-be7c-8a1867dbb173" containerID="0889c4f91e46c4dcccd16099a7a7610c93662af0530d44c2ccbc789455c177e1" exitCode=0
Jul 07 11:27:38.737065 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:38.736606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerDied","Data":"0889c4f91e46c4dcccd16099a7a7610c93662af0530d44c2ccbc789455c177e1"}
Jul 07 11:27:39.639584 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:39.639540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:39.639584 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:39.639589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:39.639832 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:39.639694    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:27:39.639832 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:39.639733    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:27:39.639832 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:39.639749    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:27:39.639832 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:39.639763    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:27:47.639746955 +0000 UTC m=+50.678971634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:27:39.639832 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:39.639791    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:27:47.639778699 +0000 UTC m=+50.679003378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:27:39.742717 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:39.742681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" event={"ID":"7761287c-1778-4853-be7c-8a1867dbb173","Type":"ContainerStarted","Data":"a26f10c6fcba90e4e71f0cf216a45a896208e65f06e08d20e5f27821227c7f98"}
Jul 07 11:27:39.767252 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:39.767194    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n4r9t" podStartSLOduration=9.558006684 podStartE2EDuration="42.767179402s" totalImagesPullingTime="33.209172718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:27:39.766962788 +0000 UTC m=+42.806187508" watchObservedRunningTime="2026-07-07 11:27:39.767179402 +0000 UTC m=+42.806404102"
Jul 07 11:27:39.887917 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:39.887885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:39.946221 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:39.946192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:43.617436 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:43.617402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:43.679236 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:43.679202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:44.972387 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:44.972351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:45.038359 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:45.038331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:45.284260 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:45.284174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:45.384679 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:45.384624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:47.698112 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:47.698067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:27:47.698112 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:47.698117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:27:47.698568 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:47.698221    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:27:47.698568 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:47.698238    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:27:47.698568 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:47.698249    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:27:47.698568 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:47.698288    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:28:03.698269237 +0000 UTC m=+66.737493916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:27:47.698568 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:27:47.698303    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:28:03.698296919 +0000 UTC m=+66.737521598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:27:55.311499 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:55.311466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:55.412142 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:55.412111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:58.709603 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:58.709566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv8qm"
Jul 07 11:27:58.867685 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:58.867651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:27:58.929026 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:27:58.928980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:28:02.103501 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.103452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:28:02.106770 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.106753    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 11:28:02.117662 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.117622    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f48c9095-444f-4e2f-9f5d-22fbe4305bf3-original-pull-secret\") pod \"global-pull-secret-syncer-vsp4z\" (UID: \"f48c9095-444f-4e2f-9f5d-22fbe4305bf3\") " pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:28:02.204128 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.204089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:28:02.204128 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.204134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:28:02.207294 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.207275    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 11:28:02.207390 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.207290    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 11:28:02.214603 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:02.214583    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 11:28:02.214705 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:02.214667    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:29:06.214650338 +0000 UTC m=+129.253875017 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : secret "metrics-daemon-secret" not found
Jul 07 11:28:02.217083 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.217063    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 11:28:02.227927 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.227892    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44bj\" (UniqueName: \"kubernetes.io/projected/15efe017-5702-4f72-abf4-bc30f14099b2-kube-api-access-h44bj\") pod \"network-check-target-vj4xk\" (UID: \"15efe017-5702-4f72-abf4-bc30f14099b2\") " pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:28:02.234461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.234439    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsp4z"
Jul 07 11:28:02.243810 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.243791    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xcgtk\""
Jul 07 11:28:02.251067 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.251045    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:28:02.388505 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.388435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vsp4z"]
Jul 07 11:28:02.391720 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:28:02.391685    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48c9095_444f_4e2f_9f5d_22fbe4305bf3.slice/crio-55b3d091ff11125deeaaa60f0f12619269d5f3b3bafc6bf1e54f786ddaa0cf5f WatchSource:0}: Error finding container 55b3d091ff11125deeaaa60f0f12619269d5f3b3bafc6bf1e54f786ddaa0cf5f: Status 404 returned error can't find the container with id 55b3d091ff11125deeaaa60f0f12619269d5f3b3bafc6bf1e54f786ddaa0cf5f
Jul 07 11:28:02.399180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.399156    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vj4xk"]
Jul 07 11:28:02.402140 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:28:02.402118    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15efe017_5702_4f72_abf4_bc30f14099b2.slice/crio-0bebb2faf01b4bb7ce287fafdcdc4d5e2a8e30cbb0ec433b33c99af340087321 WatchSource:0}: Error finding container 0bebb2faf01b4bb7ce287fafdcdc4d5e2a8e30cbb0ec433b33c99af340087321: Status 404 returned error can't find the container with id 0bebb2faf01b4bb7ce287fafdcdc4d5e2a8e30cbb0ec433b33c99af340087321
Jul 07 11:28:02.796285 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.796247    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vj4xk" event={"ID":"15efe017-5702-4f72-abf4-bc30f14099b2","Type":"ContainerStarted","Data":"0bebb2faf01b4bb7ce287fafdcdc4d5e2a8e30cbb0ec433b33c99af340087321"}
Jul 07 11:28:02.797273 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:02.797249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vsp4z" event={"ID":"f48c9095-444f-4e2f-9f5d-22fbe4305bf3","Type":"ContainerStarted","Data":"55b3d091ff11125deeaaa60f0f12619269d5f3b3bafc6bf1e54f786ddaa0cf5f"}
Jul 07 11:28:03.715771 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:03.715289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:28:03.715771 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:03.715348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:28:03.715771 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:03.715506    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:28:03.715771 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:03.715521    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:28:03.715771 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:03.715589    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:28:35.715570031 +0000 UTC m=+98.754794717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:28:03.715771 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:03.715650    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:28:03.715771 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:03.715734    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:28:35.715715278 +0000 UTC m=+98.754939974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:28:07.246977 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:07.246941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:28:07.351490 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:07.351463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:28:07.811849 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:07.811808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vj4xk" event={"ID":"15efe017-5702-4f72-abf4-bc30f14099b2","Type":"ContainerStarted","Data":"60f8ada65c2cfbd67e3face7817b02d9cc13148b0d6ecd6e49dc2465223e8c4a"}
Jul 07 11:28:07.812143 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:07.811942    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:28:07.813376 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:07.813340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vsp4z" event={"ID":"f48c9095-444f-4e2f-9f5d-22fbe4305bf3","Type":"ContainerStarted","Data":"a5eae1a9fc88cac7dabef7a634ea20d498aebeb91a0d9fe3f1c511a3736dc490"}
Jul 07 11:28:07.829595 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:07.829546    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vj4xk" podStartSLOduration=65.985770085 podStartE2EDuration="1m10.829531613s" totalImagesPullingTime="4.843761528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:28:07.828974687 +0000 UTC m=+70.868199389" watchObservedRunningTime="2026-07-07 11:28:07.829531613 +0000 UTC m=+70.868756313"
Jul 07 11:28:07.844867 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:07.844815    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vsp4z" podStartSLOduration=65.978850525 podStartE2EDuration="1m10.844799293s" totalImagesPullingTime="4.865948768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:28:07.844049862 +0000 UTC m=+70.883274564" watchObservedRunningTime="2026-07-07 11:28:07.844799293 +0000 UTC m=+70.884023993"
Jul 07 11:28:09.481210 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:09.481176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:28:09.554230 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:09.554196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:28:35.743841 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:35.743780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:28:35.743841 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:35.743837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:28:35.744423 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:35.743930    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:28:35.744423 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:35.743942    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:28:35.744423 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:35.743959    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:28:35.744423 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:35.744001    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:29:39.743987191 +0000 UTC m=+162.783211870 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:28:35.744423 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:28:35.744038    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:29:39.744019817 +0000 UTC m=+162.783244514 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:28:38.818984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:38.818953    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vj4xk"
Jul 07 11:28:41.336184 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:41.336130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:28:41.439031 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:28:41.438991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:29:06.257143 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:29:06.257088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:29:06.257669 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:06.257241    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 11:29:06.257669 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:06.257308    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:08.257291132 +0000 UTC m=+251.296515811 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : secret "metrics-daemon-secret" not found
Jul 07 11:29:34.898102 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:34.898048    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" podUID="da091e3f-541c-4b76-9da4-0ddb4085005f"
Jul 07 11:29:34.917265 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:34.917223    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dkzfh" podUID="4f9aaf7a-af6e-4a80-a12c-535f15c66f48"
Jul 07 11:29:35.023100 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:29:35.023064    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:29:35.023100 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:29:35.023097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:29:36.425910 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:36.425845    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:29:39.794302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:29:39.794245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:29:39.794302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:29:39.794305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:29:39.794811 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:39.794415    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 11:29:39.794811 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:39.794426    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f86dc9889-ss6pj: secret "image-registry-tls" not found
Jul 07 11:29:39.794811 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:39.794481    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls podName:da091e3f-541c-4b76-9da4-0ddb4085005f nodeName:}" failed. No retries permitted until 2026-07-07 11:31:41.794467996 +0000 UTC m=+284.833692676 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls") pod "image-registry-6f86dc9889-ss6pj" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f") : secret "image-registry-tls" not found
Jul 07 11:29:39.794811 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:39.794516    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 11:29:39.794811 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:29:39.794579    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls podName:4f9aaf7a-af6e-4a80-a12c-535f15c66f48 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:41.794565647 +0000 UTC m=+284.833790326 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls") pod "dns-default-dkzfh" (UID: "4f9aaf7a-af6e-4a80-a12c-535f15c66f48") : secret "dns-default-metrics-tls" not found
Jul 07 11:29:48.412341 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:29:48.412232    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:31:08.296410 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:08.296366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:31:08.296975 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:08.296533    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 11:31:08.296975 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:08.296618    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs podName:5f1eb45a-97c2-44fa-b2e8-4fde56f08886 nodeName:}" failed. No retries permitted until 2026-07-07 11:33:10.296601671 +0000 UTC m=+373.335826351 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs") pod "network-metrics-daemon-s5js2" (UID: "5f1eb45a-97c2-44fa-b2e8-4fde56f08886") : secret "metrics-daemon-secret" not found
Jul 07 11:31:26.344749 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.344717    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"]
Jul 07 11:31:26.346437 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.346419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"
Jul 07 11:31:26.348166 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.348138    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"]
Jul 07 11:31:26.349083 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.349054    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2fqpm\""
Jul 07 11:31:26.349433 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.349419    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 11:31:26.349500 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.349423    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:31:26.349775 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.349757    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"]
Jul 07 11:31:26.349907 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.349891    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.351743 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.351722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:26.352151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.352133    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 11:31:26.352570 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.352539    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s472f\""
Jul 07 11:31:26.353007 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.352984    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:31:26.353356 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.353215    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 11:31:26.353444 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.353401    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 11:31:26.354142 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.353925    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"]
Jul 07 11:31:26.354536 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.354493    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-blxbg\""
Jul 07 11:31:26.354661 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.354565    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:31:26.354661 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.354593    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 11:31:26.355777 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.355761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.356864 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.356837    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 11:31:26.358031 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.358016    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 11:31:26.358254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.358238    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:31:26.358359 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.358335    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 11:31:26.359086 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.359066    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jr866\""
Jul 07 11:31:26.359480 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.359461    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"]
Jul 07 11:31:26.362543 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.362501    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 11:31:26.365730 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.365706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"]
Jul 07 11:31:26.369080 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.369060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"]
Jul 07 11:31:26.378377 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.378353    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"]
Jul 07 11:31:26.426304 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.426251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5bb4\" (UniqueName: \"kubernetes.io/projected/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-kube-api-access-v5bb4\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.426304 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.426311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:26.426537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.426339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-config\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.426537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.426362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbvk\" (UniqueName: \"kubernetes.io/projected/ad8806bd-26ac-4d34-99a0-623798a79866-kube-api-access-ntbvk\") pod \"volume-data-source-validator-5d456fdbcd-7lbgw\" (UID: \"ad8806bd-26ac-4d34-99a0-623798a79866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"
Jul 07 11:31:26.426537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.426396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnshf\" (UniqueName: \"kubernetes.io/projected/3cb20b8d-560f-45f5-a268-e5c9387b4a10-kube-api-access-qnshf\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:26.426537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.426424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.447596 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.447562    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"]
Jul 07 11:31:26.449405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.449387    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"
Jul 07 11:31:26.452186 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.452164    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-z2chl\""
Jul 07 11:31:26.459886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.459858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"]
Jul 07 11:31:26.526968 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.526932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5bb4\" (UniqueName: \"kubernetes.io/projected/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-kube-api-access-v5bb4\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.526968 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.526971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:26.527179 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43389efd-5b7c-4452-9af6-db603e7a8d69-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.527179 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:26.527088    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 11:31:26.527179 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-config\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.527179 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbvk\" (UniqueName: \"kubernetes.io/projected/ad8806bd-26ac-4d34-99a0-623798a79866-kube-api-access-ntbvk\") pod \"volume-data-source-validator-5d456fdbcd-7lbgw\" (UID: \"ad8806bd-26ac-4d34-99a0-623798a79866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"
Jul 07 11:31:26.527179 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:26.527173    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls podName:3cb20b8d-560f-45f5-a268-e5c9387b4a10 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:27.02715667 +0000 UTC m=+270.066381349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-j6x2m" (UID: "3cb20b8d-560f-45f5-a268-e5c9387b4a10") : secret "samples-operator-tls" not found
Jul 07 11:31:26.527385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c28gx\" (UniqueName: \"kubernetes.io/projected/f3016401-7fc1-4e5f-a2e3-3f873458e0ac-kube-api-access-c28gx\") pod \"network-check-source-989f8b8dc-mzh47\" (UID: \"f3016401-7fc1-4e5f-a2e3-3f873458e0ac\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"
Jul 07 11:31:26.527385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnshf\" (UniqueName: \"kubernetes.io/projected/3cb20b8d-560f-45f5-a268-e5c9387b4a10-kube-api-access-qnshf\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:26.527385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.527385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43389efd-5b7c-4452-9af6-db603e7a8d69-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.527385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.527373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmq45\" (UniqueName: \"kubernetes.io/projected/43389efd-5b7c-4452-9af6-db603e7a8d69-kube-api-access-hmq45\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.528198 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.528153    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-config\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.529698 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.529678    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.539794 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.539765    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbvk\" (UniqueName: \"kubernetes.io/projected/ad8806bd-26ac-4d34-99a0-623798a79866-kube-api-access-ntbvk\") pod \"volume-data-source-validator-5d456fdbcd-7lbgw\" (UID: \"ad8806bd-26ac-4d34-99a0-623798a79866\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"
Jul 07 11:31:26.540032 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.540000    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5bb4\" (UniqueName: \"kubernetes.io/projected/eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e-kube-api-access-v5bb4\") pod \"service-ca-operator-5d46d9ffd4-ctpkl\" (UID: \"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.540374 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.540354    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnshf\" (UniqueName: \"kubernetes.io/projected/3cb20b8d-560f-45f5-a268-e5c9387b4a10-kube-api-access-qnshf\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:26.628767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.628676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43389efd-5b7c-4452-9af6-db603e7a8d69-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.628767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.628725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28gx\" (UniqueName: \"kubernetes.io/projected/f3016401-7fc1-4e5f-a2e3-3f873458e0ac-kube-api-access-c28gx\") pod \"network-check-source-989f8b8dc-mzh47\" (UID: \"f3016401-7fc1-4e5f-a2e3-3f873458e0ac\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"
Jul 07 11:31:26.628946 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.628789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43389efd-5b7c-4452-9af6-db603e7a8d69-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.628946 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.628858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmq45\" (UniqueName: \"kubernetes.io/projected/43389efd-5b7c-4452-9af6-db603e7a8d69-kube-api-access-hmq45\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.629290 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.629273    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43389efd-5b7c-4452-9af6-db603e7a8d69-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.631165 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.631148    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43389efd-5b7c-4452-9af6-db603e7a8d69-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.640957 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.640932    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmq45\" (UniqueName: \"kubernetes.io/projected/43389efd-5b7c-4452-9af6-db603e7a8d69-kube-api-access-hmq45\") pod \"kube-storage-version-migrator-operator-846bf668f7-vxqdm\" (UID: \"43389efd-5b7c-4452-9af6-db603e7a8d69\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.641104 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.641052    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c28gx\" (UniqueName: \"kubernetes.io/projected/f3016401-7fc1-4e5f-a2e3-3f873458e0ac-kube-api-access-c28gx\") pod \"network-check-source-989f8b8dc-mzh47\" (UID: \"f3016401-7fc1-4e5f-a2e3-3f873458e0ac\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"
Jul 07 11:31:26.648181 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.648146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:26.657519 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.657494    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"
Jul 07 11:31:26.665079 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.665054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"
Jul 07 11:31:26.678138 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.678110    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"
Jul 07 11:31:26.735187 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.735109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:26.758555 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.758297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"
Jul 07 11:31:26.809904 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.809850    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw"]
Jul 07 11:31:26.836863 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.836824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl"]
Jul 07 11:31:26.839744 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:26.839708    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6efa5b_75cf_4233_b2d9_b57a2bf29c8e.slice/crio-5d724fb6602ab9435da8f32560a7eba658c3b85fca1eb3b5a09040c582d72e1f WatchSource:0}: Error finding container 5d724fb6602ab9435da8f32560a7eba658c3b85fca1eb3b5a09040c582d72e1f: Status 404 returned error can't find the container with id 5d724fb6602ab9435da8f32560a7eba658c3b85fca1eb3b5a09040c582d72e1f
Jul 07 11:31:26.851124 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.851094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm"]
Jul 07 11:31:26.854951 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:26.854786    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43389efd_5b7c_4452_9af6_db603e7a8d69.slice/crio-126454405f2d6313a63bda13b1d8bf7b7781c081ad8896b2b01e4c04f281578f WatchSource:0}: Error finding container 126454405f2d6313a63bda13b1d8bf7b7781c081ad8896b2b01e4c04f281578f: Status 404 returned error can't find the container with id 126454405f2d6313a63bda13b1d8bf7b7781c081ad8896b2b01e4c04f281578f
Jul 07 11:31:26.911213 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:26.911130    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47"]
Jul 07 11:31:26.914061 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:26.914030    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3016401_7fc1_4e5f_a2e3_3f873458e0ac.slice/crio-c544af0fdaa666329fc1b52bf68f46c7d530206525e4d3730f94754bb40bddb7 WatchSource:0}: Error finding container c544af0fdaa666329fc1b52bf68f46c7d530206525e4d3730f94754bb40bddb7: Status 404 returned error can't find the container with id c544af0fdaa666329fc1b52bf68f46c7d530206525e4d3730f94754bb40bddb7
Jul 07 11:31:27.016573 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.016535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:27.031358 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.031321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:27.031515 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:27.031481    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 11:31:27.031562 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:27.031549    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls podName:3cb20b8d-560f-45f5-a268-e5c9387b4a10 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:28.031532964 +0000 UTC m=+271.070757644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-j6x2m" (UID: "3cb20b8d-560f-45f5-a268-e5c9387b4a10") : secret "samples-operator-tls" not found
Jul 07 11:31:27.117201 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.117155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:27.285921 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.285889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47" event={"ID":"f3016401-7fc1-4e5f-a2e3-3f873458e0ac","Type":"ContainerStarted","Data":"a38d417c81f1917a9d491c78a1b633d7a8dadea8a2501941bceec08b3f331a1e"}
Jul 07 11:31:27.286110 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.285945    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47" event={"ID":"f3016401-7fc1-4e5f-a2e3-3f873458e0ac","Type":"ContainerStarted","Data":"c544af0fdaa666329fc1b52bf68f46c7d530206525e4d3730f94754bb40bddb7"}
Jul 07 11:31:27.287104 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.287072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl" event={"ID":"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e","Type":"ContainerStarted","Data":"5d724fb6602ab9435da8f32560a7eba658c3b85fca1eb3b5a09040c582d72e1f"}
Jul 07 11:31:27.288049 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.288024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm" event={"ID":"43389efd-5b7c-4452-9af6-db603e7a8d69","Type":"ContainerStarted","Data":"126454405f2d6313a63bda13b1d8bf7b7781c081ad8896b2b01e4c04f281578f"}
Jul 07 11:31:27.289014 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.288995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw" event={"ID":"ad8806bd-26ac-4d34-99a0-623798a79866","Type":"ContainerStarted","Data":"426f74e64a464338534f26e66d7b732381be979c646f208647bbe638c9ce5817"}
Jul 07 11:31:27.302289 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:27.302240    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mzh47" podStartSLOduration=1.302223997 podStartE2EDuration="1.302223997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:27.301673081 +0000 UTC m=+270.340897795" watchObservedRunningTime="2026-07-07 11:31:27.302223997 +0000 UTC m=+270.341448676"
Jul 07 11:31:28.039341 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:28.039279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:28.039898 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:28.039469    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 11:31:28.039898 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:28.039547    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls podName:3cb20b8d-560f-45f5-a268-e5c9387b4a10 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:30.039525451 +0000 UTC m=+273.078750131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-j6x2m" (UID: "3cb20b8d-560f-45f5-a268-e5c9387b4a10") : secret "samples-operator-tls" not found
Jul 07 11:31:29.300216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:29.300173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw" event={"ID":"ad8806bd-26ac-4d34-99a0-623798a79866","Type":"ContainerStarted","Data":"09a990ec6f490366f21092eb8710e7c74c736ab92bfeae5f3c0a2d4f68358751"}
Jul 07 11:31:29.317294 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:29.317234    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7lbgw" podStartSLOduration=1.493881818 podStartE2EDuration="3.317215993s" totalImagesPullingTime="1.823334175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:29.316623336 +0000 UTC m=+272.355848059" watchObservedRunningTime="2026-07-07 11:31:29.317215993 +0000 UTC m=+272.356440694"
Jul 07 11:31:29.400363 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:29.400322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:30.055982 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.055873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:30.056132 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.056057    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 11:31:30.056171 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.056141    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls podName:3cb20b8d-560f-45f5-a268-e5c9387b4a10 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:34.056120277 +0000 UTC m=+277.095344959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-j6x2m" (UID: "3cb20b8d-560f-45f5-a268-e5c9387b4a10") : secret "samples-operator-tls" not found
Jul 07 11:31:30.065501 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.065459    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mllw2"]
Jul 07 11:31:30.068103 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.068080    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.073676 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.073646    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 11:31:30.073848 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.073698    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 11:31:30.074902 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.074878    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 11:31:30.075009 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.074897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bv7rg\""
Jul 07 11:31:30.075009 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.074899    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 11:31:30.090243 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.090197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mllw2"]
Jul 07 11:31:30.096267 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.096229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:30.156845 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.156798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/639c05bf-4313-4162-bb4c-80f7771017e5-data-volume\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.157018 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.156866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.157018 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.156895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qgkj\" (UniqueName: \"kubernetes.io/projected/639c05bf-4313-4162-bb4c-80f7771017e5-kube-api-access-2qgkj\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.157018 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.156933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/639c05bf-4313-4162-bb4c-80f7771017e5-crio-socket\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.157127 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.157026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.166243 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.166205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:30.258406 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.258371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.258406 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.258407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgkj\" (UniqueName: \"kubernetes.io/projected/639c05bf-4313-4162-bb4c-80f7771017e5-kube-api-access-2qgkj\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.258680 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.258439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/639c05bf-4313-4162-bb4c-80f7771017e5-crio-socket\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.258680 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.258476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.258680 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.258515    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 11:31:30.258680 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.258537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/639c05bf-4313-4162-bb4c-80f7771017e5-data-volume\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.258680 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.258599    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:30.758578994 +0000 UTC m=+273.797803674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : configmap "kube-rbac-proxy" not found
Jul 07 11:31:30.258680 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.258597    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/639c05bf-4313-4162-bb4c-80f7771017e5-crio-socket\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.258680 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.258660    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:30.258934 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.258720    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:30.758703744 +0000 UTC m=+273.797928423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:30.258934 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.258918    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/639c05bf-4313-4162-bb4c-80f7771017e5-data-volume\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.271097 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.271063    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgkj\" (UniqueName: \"kubernetes.io/projected/639c05bf-4313-4162-bb4c-80f7771017e5-kube-api-access-2qgkj\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.305777 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.305727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl" event={"ID":"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e","Type":"ContainerStarted","Data":"93a15baeaf941ec0864f0feed7ab16f2a266df5f7ce68785dfbd4660a50fbe33"}
Jul 07 11:31:30.307263 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.307193    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm" event={"ID":"43389efd-5b7c-4452-9af6-db603e7a8d69","Type":"ContainerStarted","Data":"7a971bd78cdbd253a1c109f575e0389493d317264879e33452e29a9c2b68f5ee"}
Jul 07 11:31:30.324878 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.324831    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl" podStartSLOduration=1.396248231 podStartE2EDuration="4.324814318s" totalImagesPullingTime="2.928566087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:30.324380462 +0000 UTC m=+273.363605159" watchObservedRunningTime="2026-07-07 11:31:30.324814318 +0000 UTC m=+273.364039019"
Jul 07 11:31:30.340436 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.340368    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm" podStartSLOduration=1.432328652 podStartE2EDuration="4.340343784s" totalImagesPullingTime="2.908015132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:30.33937632 +0000 UTC m=+273.378601023" watchObservedRunningTime="2026-07-07 11:31:30.340343784 +0000 UTC m=+273.379568485"
Jul 07 11:31:30.762701 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.762653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.762921 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.762710    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 11:31:30.762921 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.762747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:30.762921 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.762818    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:31.762785365 +0000 UTC m=+274.802010048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : configmap "kube-rbac-proxy" not found
Jul 07 11:31:30.762921 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.762880    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:30.763125 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:30.762938    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:31.762921325 +0000 UTC m=+274.802146007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:30.779294 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.779258    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"]
Jul 07 11:31:30.779473 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.779307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:30.781679 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.781655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"
Jul 07 11:31:30.784100 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.784080    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fxlxr\""
Jul 07 11:31:30.784100 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.784085    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 11:31:30.785265 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.785249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 11:31:30.793070 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.793041    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"]
Jul 07 11:31:30.863671 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.863618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x48kc\" (UniqueName: \"kubernetes.io/projected/70098997-dae5-4fcd-9f72-1a229dde987d-kube-api-access-x48kc\") pod \"migrator-d57d58cc9-lsm6m\" (UID: \"70098997-dae5-4fcd-9f72-1a229dde987d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"
Jul 07 11:31:30.867237 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.867202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:30.964308 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.964272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x48kc\" (UniqueName: \"kubernetes.io/projected/70098997-dae5-4fcd-9f72-1a229dde987d-kube-api-access-x48kc\") pod \"migrator-d57d58cc9-lsm6m\" (UID: \"70098997-dae5-4fcd-9f72-1a229dde987d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"
Jul 07 11:31:30.967142 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.967113    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:30.973446 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:30.973420    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x48kc\" (UniqueName: \"kubernetes.io/projected/70098997-dae5-4fcd-9f72-1a229dde987d-kube-api-access-x48kc\") pod \"migrator-d57d58cc9-lsm6m\" (UID: \"70098997-dae5-4fcd-9f72-1a229dde987d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"
Jul 07 11:31:31.067762 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.067668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:31.094260 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.094222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"
Jul 07 11:31:31.223790 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.223757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m"]
Jul 07 11:31:31.226723 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:31.226694    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70098997_dae5_4fcd_9f72_1a229dde987d.slice/crio-f70bf205ecfd16c9f2e260b808516c8c89395ce2c542819492b87f1e402093d1 WatchSource:0}: Error finding container f70bf205ecfd16c9f2e260b808516c8c89395ce2c542819492b87f1e402093d1: Status 404 returned error can't find the container with id f70bf205ecfd16c9f2e260b808516c8c89395ce2c542819492b87f1e402093d1
Jul 07 11:31:31.311449 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.311411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m" event={"ID":"70098997-dae5-4fcd-9f72-1a229dde987d","Type":"ContainerStarted","Data":"f70bf205ecfd16c9f2e260b808516c8c89395ce2c542819492b87f1e402093d1"}
Jul 07 11:31:31.740949 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.740905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:31.772005 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.771970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:31.772241 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.772029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:31.772241 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:31.772100    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 11:31:31.772241 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:31.772173    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:33.772153195 +0000 UTC m=+276.811377873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : configmap "kube-rbac-proxy" not found
Jul 07 11:31:31.772241 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:31.772188    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:31.772241 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:31.772242    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:33.772222945 +0000 UTC m=+276.811447626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:31.828713 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.828681    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hqz5q_daa3b874-9544-44c5-8a23-e7d1a8d3893e/dns-node-resolver/0.log"
Jul 07 11:31:31.840936 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:31.840901    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:32.830018 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:32.829987    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-89kg2_e2607803-14a5-4125-939d-8fe7b1e40de0/node-ca/0.log"
Jul 07 11:31:33.323316 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.323282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m" event={"ID":"70098997-dae5-4fcd-9f72-1a229dde987d","Type":"ContainerStarted","Data":"3d59e32c90d55315e862ff3bba1a957061a530ba420c2f38d134c1d3042c8711"}
Jul 07 11:31:33.323491 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.323359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m" event={"ID":"70098997-dae5-4fcd-9f72-1a229dde987d","Type":"ContainerStarted","Data":"38db3c8a408d6083df907b4d78d4ae7e75570bce4e486ed82c9f55e341e73f20"}
Jul 07 11:31:33.336206 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.336165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:33.340493 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.340445    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-lsm6m" podStartSLOduration=1.639200397 podStartE2EDuration="3.340429776s" totalImagesPullingTime="1.701229379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:33.339911859 +0000 UTC m=+276.379136559" watchObservedRunningTime="2026-07-07 11:31:33.340429776 +0000 UTC m=+276.379654477"
Jul 07 11:31:33.407721 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.407677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:33.507940 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.507904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:33.629607 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.629519    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7tt9g_2a5cb523-1c88-4b56-86c5-cb4a22987c5e/serve-healthcheck-canary/0.log"
Jul 07 11:31:33.789480 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.789438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:33.789681 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:33.789510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:33.789681 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:33.789573    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 11:31:33.789681 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:33.789666    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:37.789648794 +0000 UTC m=+280.828873487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : configmap "kube-rbac-proxy" not found
Jul 07 11:31:33.789798 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:33.789698    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:33.789798 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:33.789755    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:37.789741813 +0000 UTC m=+280.828966496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:34.091579 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:34.091543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:34.091978 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:34.091718    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 11:31:34.091978 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:34.091784    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls podName:3cb20b8d-560f-45f5-a268-e5c9387b4a10 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:42.091769409 +0000 UTC m=+285.130994091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-j6x2m" (UID: "3cb20b8d-560f-45f5-a268-e5c9387b4a10") : secret "samples-operator-tls" not found
Jul 07 11:31:34.246941 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:34.246902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:37.179446 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.179411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:37.291861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.291835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:37.518110 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.518015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:37.617671 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.617618    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:37.717729 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.717688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:37.823198 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.823112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:37.823198 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.823195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:37.823377 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:37.823269    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:37.823377 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:37.823278    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 11:31:37.823377 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:37.823331    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:45.823317582 +0000 UTC m=+288.862542262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : configmap "kube-rbac-proxy" not found
Jul 07 11:31:37.823377 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:37.823345    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:31:45.823338122 +0000 UTC m=+288.862562801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:37.852201 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.852162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:37.950988 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:37.950949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:38.024323 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:38.024281    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" podUID="da091e3f-541c-4b76-9da4-0ddb4085005f"
Jul 07 11:31:38.024323 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:38.024277    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dkzfh" podUID="4f9aaf7a-af6e-4a80-a12c-535f15c66f48"
Jul 07 11:31:38.070798 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:38.070763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:38.337984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:38.337949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:31:38.338410 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:38.337949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:31:38.669993 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:38.669959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:39.275371 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:39.275320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:39.459326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:39.459285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:39.914082 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:39.914039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:40.064366 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:40.064324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:40.461330 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:40.461287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:41.056267 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.056234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:41.111716 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.111682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:41.265479 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.265448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:41.857310 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.857268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:31:41.857706 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.857333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:31:41.859931 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.859906    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f9aaf7a-af6e-4a80-a12c-535f15c66f48-metrics-tls\") pod \"dns-default-dkzfh\" (UID: \"4f9aaf7a-af6e-4a80-a12c-535f15c66f48\") " pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:31:41.859931 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.859926    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"image-registry-6f86dc9889-ss6pj\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") " pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:31:41.862936 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.862903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:41.942512 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.942484    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7m7fm\""
Jul 07 11:31:41.942512 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.942501    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xqnk4\""
Jul 07 11:31:41.949892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.949869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:31:41.949954 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:41.949911    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:31:42.109525 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:42.109467    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda091e3f_541c_4b76_9da4_0ddb4085005f.slice/crio-8f4a099f22f7543dbaf186f08e86117f97fac739809f76e55f2909a4ed51fdbf WatchSource:0}: Error finding container 8f4a099f22f7543dbaf186f08e86117f97fac739809f76e55f2909a4ed51fdbf: Status 404 returned error can't find the container with id 8f4a099f22f7543dbaf186f08e86117f97fac739809f76e55f2909a4ed51fdbf
Jul 07 11:31:42.119010 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.118981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f86dc9889-ss6pj"]
Jul 07 11:31:42.119866 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.119843    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dkzfh"]
Jul 07 11:31:42.121315 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:42.121289    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9aaf7a_af6e_4a80_a12c_535f15c66f48.slice/crio-a1c10e723561ff48d3bfbf0b19afcb2890dfdfaa17901c0a0c0253ec90c85b03 WatchSource:0}: Error finding container a1c10e723561ff48d3bfbf0b19afcb2890dfdfaa17901c0a0c0253ec90c85b03: Status 404 returned error can't find the container with id a1c10e723561ff48d3bfbf0b19afcb2890dfdfaa17901c0a0c0253ec90c85b03
Jul 07 11:31:42.160366 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.160337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:42.162739 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.162715    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3cb20b8d-560f-45f5-a268-e5c9387b4a10-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-j6x2m\" (UID: \"3cb20b8d-560f-45f5-a268-e5c9387b4a10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:42.272087 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.272050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"
Jul 07 11:31:42.275367 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.275331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:42.352255 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.352214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" event={"ID":"da091e3f-541c-4b76-9da4-0ddb4085005f","Type":"ContainerStarted","Data":"d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5"}
Jul 07 11:31:42.352462 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.352281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" event={"ID":"da091e3f-541c-4b76-9da4-0ddb4085005f","Type":"ContainerStarted","Data":"8f4a099f22f7543dbaf186f08e86117f97fac739809f76e55f2909a4ed51fdbf"}
Jul 07 11:31:42.352462 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.352347    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:31:42.353484 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.353457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkzfh" event={"ID":"4f9aaf7a-af6e-4a80-a12c-535f15c66f48","Type":"ContainerStarted","Data":"a1c10e723561ff48d3bfbf0b19afcb2890dfdfaa17901c0a0c0253ec90c85b03"}
Jul 07 11:31:42.372940 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.372831    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" podStartSLOduration=286.372806623 podStartE2EDuration="4m46.372806623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:42.37177315 +0000 UTC m=+285.410997864" watchObservedRunningTime="2026-07-07 11:31:42.372806623 +0000 UTC m=+285.412031324"
Jul 07 11:31:42.406868 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.406833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m"]
Jul 07 11:31:42.460656 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:42.460607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:43.062989 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.062921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:43.291272 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.291236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:43.358860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.358759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m" event={"ID":"3cb20b8d-560f-45f5-a268-e5c9387b4a10","Type":"ContainerStarted","Data":"8d0d1ca963a92a1b9bd3e94ecabdfbbd134f8991a5ac3897b7ec2e6a77c5f0d0"}
Jul 07 11:31:43.460146 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.460106    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:43.618215 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.618117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:43.723366 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.723322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:43.824658 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.824594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:43.920548 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:43.920515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:44.058615 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:44.058579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:44.260555 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:44.260453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:44.710232 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:44.710198    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:45.264935 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.264891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:45.370890 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.370859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m" event={"ID":"3cb20b8d-560f-45f5-a268-e5c9387b4a10","Type":"ContainerStarted","Data":"5877cff78c8852c21ea6cd98605e4d9415e4b30d28b2fbc68f756f2e909ec367"}
Jul 07 11:31:45.371089 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.370966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m" event={"ID":"3cb20b8d-560f-45f5-a268-e5c9387b4a10","Type":"ContainerStarted","Data":"fcb16423bb55be5cff9089bfa05458d5b3a81826c148d900435292e0764f2574"}
Jul 07 11:31:45.372641 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.372602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkzfh" event={"ID":"4f9aaf7a-af6e-4a80-a12c-535f15c66f48","Type":"ContainerStarted","Data":"133907f5d39404ba6e5bfb1fc57786a6bd897e4a3c36d704fd6ac21fcf9a6277"}
Jul 07 11:31:45.372759 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.372659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkzfh" event={"ID":"4f9aaf7a-af6e-4a80-a12c-535f15c66f48","Type":"ContainerStarted","Data":"ce2e5c93d784319653c29c0182e5175e4a8f087803e39a11eaf96916a1a0d34c"}
Jul 07 11:31:45.372759 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.372733    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:31:45.391141 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.391094    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-j6x2m" podStartSLOduration=17.314033737 podStartE2EDuration="19.391079137s" totalImagesPullingTime="2.0770454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:45.390037449 +0000 UTC m=+288.429262151" watchObservedRunningTime="2026-07-07 11:31:45.391079137 +0000 UTC m=+288.430303838"
Jul 07 11:31:45.409031 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.408981    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dkzfh" podStartSLOduration=252.00658393 podStartE2EDuration="4m14.408958355s" totalImagesPullingTime="2.402374425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:45.408168429 +0000 UTC m=+288.447393130" watchObservedRunningTime="2026-07-07 11:31:45.408958355 +0000 UTC m=+288.448183406"
Jul 07 11:31:45.482326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.482287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:45.863347 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.863309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:45.890917 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.890881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:45.891023 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.890934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:45.891070 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:45.891035    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:45.891113 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:45.891098    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls podName:639c05bf-4313-4162-bb4c-80f7771017e5 nodeName:}" failed. No retries permitted until 2026-07-07 11:32:01.891080105 +0000 UTC m=+304.930304786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mllw2" (UID: "639c05bf-4313-4162-bb4c-80f7771017e5") : secret "insights-runtime-extractor-tls" not found
Jul 07 11:31:45.891408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:45.891387    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/639c05bf-4313-4162-bb4c-80f7771017e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:31:46.060724 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:46.060683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:46.689901 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:46.689858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:47.065659 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:47.065544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:47.460357 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:47.460313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:47.659999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:47.659964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:47.861258 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:47.861167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:51.413011 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:31:51.412959    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s5js2" podUID="5f1eb45a-97c2-44fa-b2e8-4fde56f08886"
Jul 07 11:31:52.128481 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:52.128449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:52.229582 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:52.229552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:52.330152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:52.330117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:52.439710 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:52.439681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:52.612904 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:52.612868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:53.226140 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:53.226092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:53.325961 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:53.325924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:53.622385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:53.622302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:53.723045 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:53.723010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:53.862921 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:53.862880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:54.019204 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.019173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:54.023565 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.023540    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-zb6jj"]
Jul 07 11:31:54.028979 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.028960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-zb6jj"
Jul 07 11:31:54.031763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.031740    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m5pp7\""
Jul 07 11:31:54.031977 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.031960    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 11:31:54.032057 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.031993    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 11:31:54.039381 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.039356    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f86dc9889-ss6pj"]
Jul 07 11:31:54.040308 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.040290    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-zb6jj"]
Jul 07 11:31:54.054870 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.054813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7jnf\" (UniqueName: \"kubernetes.io/projected/558ffcaf-ed44-4a54-bf1c-776c43133716-kube-api-access-w7jnf\") pod \"downloads-685bfb5f64-zb6jj\" (UID: \"558ffcaf-ed44-4a54-bf1c-776c43133716\") " pod="openshift-console/downloads-685bfb5f64-zb6jj"
Jul 07 11:31:54.117972 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.117921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:54.125030 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.124999    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57dfccbfb5-rp42q"]
Jul 07 11:31:54.129003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.128985    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.138540 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.138509    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57dfccbfb5-rp42q"]
Jul 07 11:31:54.156056 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6bc5ec6-5d41-46e9-931c-088502c43320-ca-trust-extracted\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156056 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bww6\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-kube-api-access-5bww6\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156247 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6bc5ec6-5d41-46e9-931c-088502c43320-image-registry-private-configuration\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156247 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6bc5ec6-5d41-46e9-931c-088502c43320-installation-pull-secrets\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156247 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6bc5ec6-5d41-46e9-931c-088502c43320-trusted-ca\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156247 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-bound-sa-token\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156247 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-registry-tls\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156452 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6bc5ec6-5d41-46e9-931c-088502c43320-registry-certificates\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.156452 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.156282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jnf\" (UniqueName: \"kubernetes.io/projected/558ffcaf-ed44-4a54-bf1c-776c43133716-kube-api-access-w7jnf\") pod \"downloads-685bfb5f64-zb6jj\" (UID: \"558ffcaf-ed44-4a54-bf1c-776c43133716\") " pod="openshift-console/downloads-685bfb5f64-zb6jj"
Jul 07 11:31:54.168930 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.168895    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7jnf\" (UniqueName: \"kubernetes.io/projected/558ffcaf-ed44-4a54-bf1c-776c43133716-kube-api-access-w7jnf\") pod \"downloads-685bfb5f64-zb6jj\" (UID: \"558ffcaf-ed44-4a54-bf1c-776c43133716\") " pod="openshift-console/downloads-685bfb5f64-zb6jj"
Jul 07 11:31:54.214477 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.214439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:54.257383 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6bc5ec6-5d41-46e9-931c-088502c43320-registry-certificates\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257564 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6bc5ec6-5d41-46e9-931c-088502c43320-ca-trust-extracted\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257564 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bww6\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-kube-api-access-5bww6\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257564 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6bc5ec6-5d41-46e9-931c-088502c43320-image-registry-private-configuration\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257735 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6bc5ec6-5d41-46e9-931c-088502c43320-installation-pull-secrets\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257735 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6bc5ec6-5d41-46e9-931c-088502c43320-trusted-ca\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257847 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-bound-sa-token\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257847 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-registry-tls\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.257938 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.257905    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6bc5ec6-5d41-46e9-931c-088502c43320-ca-trust-extracted\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.258235 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.258198    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6bc5ec6-5d41-46e9-931c-088502c43320-registry-certificates\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.258805 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.258774    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6bc5ec6-5d41-46e9-931c-088502c43320-trusted-ca\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.260064 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.260045    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6bc5ec6-5d41-46e9-931c-088502c43320-image-registry-private-configuration\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.260307 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.260284    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-registry-tls\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.260397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.260381    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6bc5ec6-5d41-46e9-931c-088502c43320-installation-pull-secrets\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.267831 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.267801    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-bound-sa-token\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.268003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.267977    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bww6\" (UniqueName: \"kubernetes.io/projected/e6bc5ec6-5d41-46e9-931c-088502c43320-kube-api-access-5bww6\") pod \"image-registry-57dfccbfb5-rp42q\" (UID: \"e6bc5ec6-5d41-46e9-931c-088502c43320\") " pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.337997 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.337893    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-zb6jj"
Jul 07 11:31:54.437968 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.437935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:54.493602 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.493569    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-zb6jj"]
Jul 07 11:31:54.497047 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:54.497020    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558ffcaf_ed44_4a54_bf1c_776c43133716.slice/crio-6f6be5ebbe6fd7fd929e78e1e939849464b4197ed7a37cdc5b7d4fb00f7541ed WatchSource:0}: Error finding container 6f6be5ebbe6fd7fd929e78e1e939849464b4197ed7a37cdc5b7d4fb00f7541ed: Status 404 returned error can't find the container with id 6f6be5ebbe6fd7fd929e78e1e939849464b4197ed7a37cdc5b7d4fb00f7541ed
Jul 07 11:31:54.575981 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:54.575955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57dfccbfb5-rp42q"]
Jul 07 11:31:54.578318 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:54.578294    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bc5ec6_5d41_46e9_931c_088502c43320.slice/crio-6936fbd292c3e857cc531067f3d4077748e6ba67d6feb84f6912aa84825b67d5 WatchSource:0}: Error finding container 6936fbd292c3e857cc531067f3d4077748e6ba67d6feb84f6912aa84825b67d5: Status 404 returned error can't find the container with id 6936fbd292c3e857cc531067f3d4077748e6ba67d6feb84f6912aa84825b67d5
Jul 07 11:31:55.378322 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.378293    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dkzfh"
Jul 07 11:31:55.417831 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.417695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-zb6jj" event={"ID":"558ffcaf-ed44-4a54-bf1c-776c43133716","Type":"ContainerStarted","Data":"6f6be5ebbe6fd7fd929e78e1e939849464b4197ed7a37cdc5b7d4fb00f7541ed"}
Jul 07 11:31:55.417831 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.417743    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q" event={"ID":"e6bc5ec6-5d41-46e9-931c-088502c43320","Type":"ContainerStarted","Data":"deb4511c95ea802d0766da5b361c791eaeed3b8a90cb8f9dc16e9599bf3e68c6"}
Jul 07 11:31:55.417831 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.417778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:31:55.417831 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.417797    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q" event={"ID":"e6bc5ec6-5d41-46e9-931c-088502c43320","Type":"ContainerStarted","Data":"6936fbd292c3e857cc531067f3d4077748e6ba67d6feb84f6912aa84825b67d5"}
Jul 07 11:31:55.440468 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.440414    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q" podStartSLOduration=1.440397147 podStartE2EDuration="1.440397147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:31:55.438891553 +0000 UTC m=+298.478116255" watchObservedRunningTime="2026-07-07 11:31:55.440397147 +0000 UTC m=+298.479621842"
Jul 07 11:31:55.446786 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.446751    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:55.503875 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:55.503841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:31:57.327365 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:57.327334    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:31:57.328384 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:57.328303    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:31:57.331981 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:57.331955    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 11:31:59.248418 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.248383    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-654cfc96b5-g5rpn"]
Jul 07 11:31:59.281200 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.281146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654cfc96b5-g5rpn"]
Jul 07 11:31:59.281297 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.281247    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.285043 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.285010    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 11:31:59.285247 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.285117    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 11:31:59.286135 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.286117    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 11:31:59.286272 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.286144    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 11:31:59.286272 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.286122    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 11:31:59.286272 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.286122    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mjmt6\""
Jul 07 11:31:59.403118 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.403075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-oauth-config\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.403302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.403130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65ld\" (UniqueName: \"kubernetes.io/projected/4203968b-ece0-4229-8336-cd6acccee961-kube-api-access-d65ld\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.403302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.403170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-console-config\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.403302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.403195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-serving-cert\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.403302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.403251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-service-ca\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.403302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.403278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-oauth-serving-cert\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.504012 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.503914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-serving-cert\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.504012 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.503974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-service-ca\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.504012 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.504001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-oauth-serving-cert\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.504287 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.504081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-oauth-config\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.504287 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.504108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d65ld\" (UniqueName: \"kubernetes.io/projected/4203968b-ece0-4229-8336-cd6acccee961-kube-api-access-d65ld\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.504287 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.504141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-console-config\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.504896 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.504871    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-console-config\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.505044 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.505013    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-oauth-serving-cert\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.505044 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.505029    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-service-ca\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.507016 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.506991    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-serving-cert\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.507302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.507278    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-oauth-config\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.514121 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.514068    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65ld\" (UniqueName: \"kubernetes.io/projected/4203968b-ece0-4229-8336-cd6acccee961-kube-api-access-d65ld\") pod \"console-654cfc96b5-g5rpn\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") " pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.591094 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.591052    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:31:59.755310 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.755239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654cfc96b5-g5rpn"]
Jul 07 11:31:59.758793 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:31:59.758764    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4203968b_ece0_4229_8336_cd6acccee961.slice/crio-219a4b67ffb2204248a3624eecb864339734a972b71e9067274117418b3045a3 WatchSource:0}: Error finding container 219a4b67ffb2204248a3624eecb864339734a972b71e9067274117418b3045a3: Status 404 returned error can't find the container with id 219a4b67ffb2204248a3624eecb864339734a972b71e9067274117418b3045a3
Jul 07 11:31:59.761532 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:31:59.761511    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:32:00.441027 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:00.440991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654cfc96b5-g5rpn" event={"ID":"4203968b-ece0-4229-8336-cd6acccee961","Type":"ContainerStarted","Data":"219a4b67ffb2204248a3624eecb864339734a972b71e9067274117418b3045a3"}
Jul 07 11:32:00.879393 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:00.879306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:00.975319 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:00.975242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:01.039538 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:01.039500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:01.193945 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:01.193902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:01.927142 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:01.927106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:32:01.929983 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:01.929957    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/639c05bf-4313-4162-bb4c-80f7771017e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mllw2\" (UID: \"639c05bf-4313-4162-bb4c-80f7771017e5\") " pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:32:02.182265 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:02.182171    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bv7rg\""
Jul 07 11:32:02.189726 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:02.189690    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mllw2"
Jul 07 11:32:02.355529 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:02.355350    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mllw2"]
Jul 07 11:32:03.063649 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:03.063512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:03.152498 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:03.152377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:03.563743 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:32:03.563704    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639c05bf_4313_4162_bb4c_80f7771017e5.slice/crio-a39c4536d3be4e42e7d5e64885f4ef17515a24073a2e3aafd32467423580a463 WatchSource:0}: Error finding container a39c4536d3be4e42e7d5e64885f4ef17515a24073a2e3aafd32467423580a463: Status 404 returned error can't find the container with id a39c4536d3be4e42e7d5e64885f4ef17515a24073a2e3aafd32467423580a463
Jul 07 11:32:03.854388 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:03.854299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:04.049306 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:04.049075    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:32:04.464005 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:04.463892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654cfc96b5-g5rpn" event={"ID":"4203968b-ece0-4229-8336-cd6acccee961","Type":"ContainerStarted","Data":"9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c"}
Jul 07 11:32:04.466319 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:04.466285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mllw2" event={"ID":"639c05bf-4313-4162-bb4c-80f7771017e5","Type":"ContainerStarted","Data":"a39c4536d3be4e42e7d5e64885f4ef17515a24073a2e3aafd32467423580a463"}
Jul 07 11:32:04.484875 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:04.484767    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-654cfc96b5-g5rpn" podStartSLOduration=1.651289506 podStartE2EDuration="5.484743236s" totalImagesPullingTime="3.83345373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:04.483349782 +0000 UTC m=+307.522574486" watchObservedRunningTime="2026-07-07 11:32:04.484743236 +0000 UTC m=+307.523967918"
Jul 07 11:32:04.519569 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:04.519531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:05.412013 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:05.411977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:32:07.960832 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:07.960791    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:08.062257 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:08.062210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:08.161497 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:08.161451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:08.217858 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:08.217769    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:09.591278 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:09.591218    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:32:09.591800 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:09.591333    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:32:09.596791 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:09.596762    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:32:09.656663 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:09.656571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:09.710585 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:09.710543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:10.223569 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.223518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:10.324848 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.324808    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:10.496427 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.496334    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:32:10.522844 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.522806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:10.640528 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.640491    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nfjqh"]
Jul 07 11:32:10.643786 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.643755    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.647314 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.647286    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 11:32:10.647663 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.647625    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 11:32:10.648238 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.648220    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9pw78\""
Jul 07 11:32:10.648346 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.648244    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 11:32:10.648346 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.648251    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 11:32:10.648938 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.648770    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 11:32:10.649031 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.649001    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 11:32:10.693408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.693373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:10.711496 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711723 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-textfile\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711723 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-root\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711723 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711723 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-tls\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711723 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdvtm\" (UniqueName: \"kubernetes.io/projected/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-kube-api-access-vdvtm\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711928 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-sys\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711928 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-metrics-client-ca\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.711928 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.711864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-wtmp\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.778229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.778141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:10.812360 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-sys\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812360 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-metrics-client-ca\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812393    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-sys\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-wtmp\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-textfile\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-root\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-tls\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812964 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812596    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-root\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812964 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812604    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-wtmp\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812964 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdvtm\" (UniqueName: \"kubernetes.io/projected/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-kube-api-access-vdvtm\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.812964 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.812951    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-textfile\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.813164 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.813142    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-metrics-client-ca\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.813611 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.813586    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.815267 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.815244    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-tls\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.815394 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.815373    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.822263 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.822230    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdvtm\" (UniqueName: \"kubernetes.io/projected/aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d-kube-api-access-vdvtm\") pod \"node-exporter-nfjqh\" (UID: \"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d\") " pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:10.956537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:10.956484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfjqh"
Jul 07 11:32:11.012746 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.012708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:11.231138 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.231101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:11.448884 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.448793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:11.550087 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.549931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:11.559930 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.559889    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:32:11.562891 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.562847    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.565662 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.565610    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 11:32:11.565662 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.565609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tncrs\""
Jul 07 11:32:11.565959 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.565941    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 11:32:11.566019 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.565962    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 11:32:11.566019 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.565987    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 11:32:11.566019 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.566014    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 11:32:11.566152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.565963    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 11:32:11.566152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.566014    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 11:32:11.566152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.565944    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 11:32:11.566307 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.566215    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 11:32:11.581385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.581347    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:32:11.720662 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.720612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/44994288-e290-43cd-bbd1-51940a28251d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.720754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxnkl\" (UniqueName: \"kubernetes.io/projected/44994288-e290-43cd-bbd1-51940a28251d-kube-api-access-kxnkl\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.720812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44994288-e290-43cd-bbd1-51940a28251d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.720863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44994288-e290-43cd-bbd1-51940a28251d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.720950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.720989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44994288-e290-43cd-bbd1-51940a28251d-config-out\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.721021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-config-volume\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.721044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44994288-e290-43cd-bbd1-51940a28251d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.721097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721539 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.721183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721539 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.721233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721539 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.721258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.721539 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.721272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-web-config\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.749031 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.748978    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:11.822698 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822698 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822698 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-web-config\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/44994288-e290-43cd-bbd1-51940a28251d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxnkl\" (UniqueName: \"kubernetes.io/projected/44994288-e290-43cd-bbd1-51940a28251d-kube-api-access-kxnkl\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44994288-e290-43cd-bbd1-51940a28251d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44994288-e290-43cd-bbd1-51940a28251d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44994288-e290-43cd-bbd1-51940a28251d-config-out\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-config-volume\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.822984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.822979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44994288-e290-43cd-bbd1-51940a28251d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.823871 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.823839    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44994288-e290-43cd-bbd1-51940a28251d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.824216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.824010    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/44994288-e290-43cd-bbd1-51940a28251d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.824727 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.824617    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44994288-e290-43cd-bbd1-51940a28251d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.826229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.826200    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44994288-e290-43cd-bbd1-51940a28251d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.826325 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.826216    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44994288-e290-43cd-bbd1-51940a28251d-config-out\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.826757 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.826710    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.827616 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.827569    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-web-config\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.827815 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.827782    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.827815 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.827808    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.828402 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.828199    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.828608 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.828567    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-config-volume\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.829931 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.829910    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/44994288-e290-43cd-bbd1-51940a28251d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.835669 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.835624    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxnkl\" (UniqueName: \"kubernetes.io/projected/44994288-e290-43cd-bbd1-51940a28251d-kube-api-access-kxnkl\") pod \"alertmanager-main-0\" (UID: \"44994288-e290-43cd-bbd1-51940a28251d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:11.875697 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:11.875655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:32:12.273695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:12.273652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:13.419780 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:13.419743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:13.521140 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:13.521105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:13.620669 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:13.620613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:13.719544 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:13.719450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:14.537156 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.537118    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-786954f874-jzzw2"]
Jul 07 11:32:14.540201 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.540178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.543240 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.543081    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 11:32:14.543240 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.543096    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 11:32:14.543240 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.543164    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 11:32:14.543490 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.543255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-76jf4ji7ebib2\""
Jul 07 11:32:14.543490 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.543452    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 11:32:14.543490 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.543457    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 11:32:14.544299 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.544282    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ngqkz\""
Jul 07 11:32:14.552499 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.552469    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-786954f874-jzzw2"]
Jul 07 11:32:14.644260 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:32:14.644219    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa8c1fa_1e3e_40ff_9a05_6c8a3519538d.slice/crio-9349fceb79d0c49d07c99a77b08759ba408ec49268582a6e1b53060824f6f903 WatchSource:0}: Error finding container 9349fceb79d0c49d07c99a77b08759ba408ec49268582a6e1b53060824f6f903: Status 404 returned error can't find the container with id 9349fceb79d0c49d07c99a77b08759ba408ec49268582a6e1b53060824f6f903
Jul 07 11:32:14.653673 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.653640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-grpc-tls\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.653835 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.653806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-tls\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.653905 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.653859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5rw\" (UniqueName: \"kubernetes.io/projected/32fac2e8-b811-41d9-85e0-2eed643230c1-kube-api-access-zw5rw\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.653905 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.653893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.654015 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.653929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32fac2e8-b811-41d9-85e0-2eed643230c1-metrics-client-ca\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.654015 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.653985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.654333 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.654031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.654333 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.654061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.754983 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.754922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-grpc-tls\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.755186 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-tls\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.755186 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5rw\" (UniqueName: \"kubernetes.io/projected/32fac2e8-b811-41d9-85e0-2eed643230c1-kube-api-access-zw5rw\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.755186 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.755186 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32fac2e8-b811-41d9-85e0-2eed643230c1-metrics-client-ca\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.755186 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.755606 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.755606 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.756013 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.755984    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32fac2e8-b811-41d9-85e0-2eed643230c1-metrics-client-ca\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.759072 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.759007    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-tls\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.759274 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.759221    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.759522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.759467    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-grpc-tls\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.759618 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.759508    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.759916 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.759890    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.760137 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.760107    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32fac2e8-b811-41d9-85e0-2eed643230c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.765468 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.765437    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5rw\" (UniqueName: \"kubernetes.io/projected/32fac2e8-b811-41d9-85e0-2eed643230c1-kube-api-access-zw5rw\") pod \"thanos-querier-786954f874-jzzw2\" (UID: \"32fac2e8-b811-41d9-85e0-2eed643230c1\") " pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:14.777240 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.777208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:32:14.778885 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:32:14.778836    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44994288_e290_43cd_bbd1_51940a28251d.slice/crio-c9984f761e7bf6908d4531921b86b6ee53aa57c2621869e9ee4328697ef725d3 WatchSource:0}: Error finding container c9984f761e7bf6908d4531921b86b6ee53aa57c2621869e9ee4328697ef725d3: Status 404 returned error can't find the container with id c9984f761e7bf6908d4531921b86b6ee53aa57c2621869e9ee4328697ef725d3
Jul 07 11:32:14.852903 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:14.852813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:15.015751 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.015714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-786954f874-jzzw2"]
Jul 07 11:32:15.019584 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:32:15.019540    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fac2e8_b811_41d9_85e0_2eed643230c1.slice/crio-cfe801e3182918eae7cb907dae35dfc73bd9c2bacb371fb15ec7d2d28f6354ff WatchSource:0}: Error finding container cfe801e3182918eae7cb907dae35dfc73bd9c2bacb371fb15ec7d2d28f6354ff: Status 404 returned error can't find the container with id cfe801e3182918eae7cb907dae35dfc73bd9c2bacb371fb15ec7d2d28f6354ff
Jul 07 11:32:15.242158 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.242116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:15.251194 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.251152    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"]
Jul 07 11:32:15.255166 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.255130    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:15.258792 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.258520    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b64tt\""
Jul 07 11:32:15.258792 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.258562    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 11:32:15.262771 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.262708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"]
Jul 07 11:32:15.314591 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.314441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:15.364500 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.363063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z7bds\" (UID: \"9a5d68f6-e660-4762-ae78-7a68f03c9a7f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:15.364500 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.363136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dssbq\" (UniqueName: \"kubernetes.io/projected/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-kube-api-access-dssbq\") pod \"monitoring-plugin-d5dcff7cf-z7bds\" (UID: \"9a5d68f6-e660-4762-ae78-7a68f03c9a7f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:15.464113 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.464067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z7bds\" (UID: \"9a5d68f6-e660-4762-ae78-7a68f03c9a7f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:15.464267 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.464156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dssbq\" (UniqueName: \"kubernetes.io/projected/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-kube-api-access-dssbq\") pod \"monitoring-plugin-d5dcff7cf-z7bds\" (UID: \"9a5d68f6-e660-4762-ae78-7a68f03c9a7f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:15.464650 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:32:15.464602    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 07 11:32:15.464771 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:32:15.464749    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-monitoring-plugin-cert podName:9a5d68f6-e660-4762-ae78-7a68f03c9a7f nodeName:}" failed. No retries permitted until 2026-07-07 11:32:15.96469183 +0000 UTC m=+319.003916523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-z7bds" (UID: "9a5d68f6-e660-4762-ae78-7a68f03c9a7f") : secret "monitoring-plugin-cert" not found
Jul 07 11:32:15.474117 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.474085    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dssbq\" (UniqueName: \"kubernetes.io/projected/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-kube-api-access-dssbq\") pod \"monitoring-plugin-d5dcff7cf-z7bds\" (UID: \"9a5d68f6-e660-4762-ae78-7a68f03c9a7f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:15.514367 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.513576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-zb6jj" event={"ID":"558ffcaf-ed44-4a54-bf1c-776c43133716","Type":"ContainerStarted","Data":"6790f2bec381c9a7bda58b14d301a5225f1b340716d93f0484a9ee7dd5d0ab9e"}
Jul 07 11:32:15.514549 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.514502    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-zb6jj"
Jul 07 11:32:15.516412 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.516309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mllw2" event={"ID":"639c05bf-4313-4162-bb4c-80f7771017e5","Type":"ContainerStarted","Data":"9ee9e75f20d412d3c43df43e313a9299d2eb385096e419e6558c11266da2f1b5"}
Jul 07 11:32:15.516412 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.516369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mllw2" event={"ID":"639c05bf-4313-4162-bb4c-80f7771017e5","Type":"ContainerStarted","Data":"ca6f9d0253f7cfedc66640e4022164ee5a88555883f49cc4a55b1ddce52e5b77"}
Jul 07 11:32:15.518270 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.518245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerStarted","Data":"c9984f761e7bf6908d4531921b86b6ee53aa57c2621869e9ee4328697ef725d3"}
Jul 07 11:32:15.519866 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.519844    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" event={"ID":"32fac2e8-b811-41d9-85e0-2eed643230c1","Type":"ContainerStarted","Data":"cfe801e3182918eae7cb907dae35dfc73bd9c2bacb371fb15ec7d2d28f6354ff"}
Jul 07 11:32:15.520755 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.520727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-zb6jj"
Jul 07 11:32:15.521578 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.521546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfjqh" event={"ID":"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d","Type":"ContainerStarted","Data":"9349fceb79d0c49d07c99a77b08759ba408ec49268582a6e1b53060824f6f903"}
Jul 07 11:32:15.533461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.533383    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-zb6jj" podStartSLOduration=1.361682365 podStartE2EDuration="21.533360361s" totalImagesPullingTime="20.171677996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:15.53168787 +0000 UTC m=+318.570912571" watchObservedRunningTime="2026-07-07 11:32:15.533360361 +0000 UTC m=+318.572585062"
Jul 07 11:32:15.800513 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.800418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:15.971884 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.971466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z7bds\" (UID: \"9a5d68f6-e660-4762-ae78-7a68f03c9a7f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:15.975971 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:15.975074    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a5d68f6-e660-4762-ae78-7a68f03c9a7f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z7bds\" (UID: \"9a5d68f6-e660-4762-ae78-7a68f03c9a7f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:16.168826 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:16.168773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:16.431788 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:16.427511    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57dfccbfb5-rp42q"
Jul 07 11:32:16.537408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:16.537330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfjqh" event={"ID":"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d","Type":"ContainerStarted","Data":"00be19b9c40b82f5e4c11c5df0790fd084a0b56935b9334316aa54f6687a96db"}
Jul 07 11:32:16.629555 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:16.623697    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:16.730453 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:16.730337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:16.831279 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:16.831164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"]
Jul 07 11:32:16.832502 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:32:16.832376    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5d68f6_e660_4762_ae78_7a68f03c9a7f.slice/crio-4b0c9753c4d2181f558ae3653ee7b6f66e331e8d4ef33a5308d9c45cb6939602 WatchSource:0}: Error finding container 4b0c9753c4d2181f558ae3653ee7b6f66e331e8d4ef33a5308d9c45cb6939602: Status 404 returned error can't find the container with id 4b0c9753c4d2181f558ae3653ee7b6f66e331e8d4ef33a5308d9c45cb6939602
Jul 07 11:32:16.857543 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:16.857506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:17.053721 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.052958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:17.150747 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.150614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:17.256317 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.256221    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:17.349153 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.349061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:17.462231 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.462192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:17.502678 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.502644    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78998f6486-8gxkr"]
Jul 07 11:32:17.519614 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.519585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.525712 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.525620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78998f6486-8gxkr"]
Jul 07 11:32:17.536070 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.535831    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 11:32:17.547163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.547126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds" event={"ID":"9a5d68f6-e660-4762-ae78-7a68f03c9a7f","Type":"ContainerStarted","Data":"4b0c9753c4d2181f558ae3653ee7b6f66e331e8d4ef33a5308d9c45cb6939602"}
Jul 07 11:32:17.551008 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.550116    2564 generic.go:356] "Generic (PLEG): container finished" podID="44994288-e290-43cd-bbd1-51940a28251d" containerID="9b9f015d64d59538a305ed01b26c0eb614bc6cfdf6c0380a422e588e7332f913" exitCode=0
Jul 07 11:32:17.551008 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.550197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerDied","Data":"9b9f015d64d59538a305ed01b26c0eb614bc6cfdf6c0380a422e588e7332f913"}
Jul 07 11:32:17.557961 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.557080    2564 generic.go:356] "Generic (PLEG): container finished" podID="aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d" containerID="00be19b9c40b82f5e4c11c5df0790fd084a0b56935b9334316aa54f6687a96db" exitCode=0
Jul 07 11:32:17.557961 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.557845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfjqh" event={"ID":"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d","Type":"ContainerDied","Data":"00be19b9c40b82f5e4c11c5df0790fd084a0b56935b9334316aa54f6687a96db"}
Jul 07 11:32:17.561535 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.561511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:17.700002 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.699961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-trusted-ca-bundle\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.700229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.700102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b9ml\" (UniqueName: \"kubernetes.io/projected/4b885f90-9457-4a11-afc6-0c78985e1f3e-kube-api-access-5b9ml\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.700229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.700134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-serving-cert\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.700229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.700158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-oauth-serving-cert\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.700455 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.700266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-oauth-config\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.700509 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.700463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-config\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.700509 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.700497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-service-ca\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.801724 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.801682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-trusted-ca-bundle\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.801904 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.801765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b9ml\" (UniqueName: \"kubernetes.io/projected/4b885f90-9457-4a11-afc6-0c78985e1f3e-kube-api-access-5b9ml\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.801904 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.801792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-serving-cert\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.801904 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.801813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-oauth-serving-cert\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.801904 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.801870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-oauth-config\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.802100 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.801936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-config\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.803502 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.803445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-service-ca\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.804065 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.803754    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-oauth-serving-cert\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.804322 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.804299    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-service-ca\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.804514 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.804494    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-config\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.805265 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.805165    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-trusted-ca-bundle\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.808857 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.808665    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-oauth-config\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.811388 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.811334    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-serving-cert\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.822269 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.822209    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b9ml\" (UniqueName: \"kubernetes.io/projected/4b885f90-9457-4a11-afc6-0c78985e1f3e-kube-api-access-5b9ml\") pod \"console-78998f6486-8gxkr\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") " pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:17.841560 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:17.841441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:18.573354 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:18.573311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfjqh" event={"ID":"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d","Type":"ContainerStarted","Data":"87963075fab582d8034ad7fd83857be5fcd5d6810c604db33524d4e56b263fd4"}
Jul 07 11:32:18.573567 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:18.573423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfjqh" event={"ID":"aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d","Type":"ContainerStarted","Data":"9324c811ec7f57089fd202600e6fee2402adc65c3c1cf94a3d48af1cbff6f4ff"}
Jul 07 11:32:18.596049 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:18.595989    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nfjqh" podStartSLOduration=7.240179189 podStartE2EDuration="8.595965049s" totalImagesPullingTime="1.239437891s" totalInitContainerRuntime="116.347969ms" isStatefulPod=true podCreationTimestamp="2026-07-07 11:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:18.594552253 +0000 UTC m=+321.633776991" watchObservedRunningTime="2026-07-07 11:32:18.595965049 +0000 UTC m=+321.635189751"
Jul 07 11:32:19.061099 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:19.061050    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" podUID="da091e3f-541c-4b76-9da4-0ddb4085005f" containerName="registry" containerID="cri-o://d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5" gracePeriod=30
Jul 07 11:32:21.322398 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.322307    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78998f6486-8gxkr"]
Jul 07 11:32:21.333539 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:32:21.333497    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b885f90_9457_4a11_afc6_0c78985e1f3e.slice/crio-181e57515d2cf998e2467f7f0f4876cde4a30d8ca24405505b40fa267120d2c2 WatchSource:0}: Error finding container 181e57515d2cf998e2467f7f0f4876cde4a30d8ca24405505b40fa267120d2c2: Status 404 returned error can't find the container with id 181e57515d2cf998e2467f7f0f4876cde4a30d8ca24405505b40fa267120d2c2
Jul 07 11:32:21.340892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.340612    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436568    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-installation-pull-secrets\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436622    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-trusted-ca\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436674    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6c5v\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-kube-api-access-f6c5v\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-image-registry-private-configuration\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436793    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-bound-sa-token\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da091e3f-541c-4b76-9da4-0ddb4085005f-ca-trust-extracted\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-certificates\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.437492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.436911    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") pod \"da091e3f-541c-4b76-9da4-0ddb4085005f\" (UID: \"da091e3f-541c-4b76-9da4-0ddb4085005f\") "
Jul 07 11:32:21.439830 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.439465    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:32:21.439830 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.439745    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:32:21.442977 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.442921    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:32:21.443706 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.443594    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:32:21.443706 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.443688    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:32:21.443868 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.443778    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:32:21.444244 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.444224    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-kube-api-access-f6c5v" (OuterVolumeSpecName: "kube-api-access-f6c5v") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "kube-api-access-f6c5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:32:21.453875 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.453840    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da091e3f-541c-4b76-9da4-0ddb4085005f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "da091e3f-541c-4b76-9da4-0ddb4085005f" (UID: "da091e3f-541c-4b76-9da4-0ddb4085005f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537689    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-image-registry-private-configuration\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537726    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-bound-sa-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537743    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da091e3f-541c-4b76-9da4-0ddb4085005f-ca-trust-extracted\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537757    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-certificates\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537774    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-registry-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537789    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da091e3f-541c-4b76-9da4-0ddb4085005f-installation-pull-secrets\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537803    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da091e3f-541c-4b76-9da4-0ddb4085005f-trusted-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.537860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.537816    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6c5v\" (UniqueName: \"kubernetes.io/projected/da091e3f-541c-4b76-9da4-0ddb4085005f-kube-api-access-f6c5v\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:21.592239 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.592146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mllw2" event={"ID":"639c05bf-4313-4162-bb4c-80f7771017e5","Type":"ContainerStarted","Data":"7c2f174300d440ccb774f0ed38524d9f2cd080f3fd7aaea4df9969af863b082c"}
Jul 07 11:32:21.594236 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.594162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds" event={"ID":"9a5d68f6-e660-4762-ae78-7a68f03c9a7f","Type":"ContainerStarted","Data":"96676f97ddec0b6889c7dad2b1e6d43257efda60da2a4b4576a7780e25615923"}
Jul 07 11:32:21.594481 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.594428    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:21.596029 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.595960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78998f6486-8gxkr" event={"ID":"4b885f90-9457-4a11-afc6-0c78985e1f3e","Type":"ContainerStarted","Data":"181e57515d2cf998e2467f7f0f4876cde4a30d8ca24405505b40fa267120d2c2"}
Jul 07 11:32:21.597923 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.597899    2564 generic.go:356] "Generic (PLEG): container finished" podID="da091e3f-541c-4b76-9da4-0ddb4085005f" containerID="d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5" exitCode=0
Jul 07 11:32:21.598046 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.598031    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj"
Jul 07 11:32:21.598367 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.598341    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" event={"ID":"da091e3f-541c-4b76-9da4-0ddb4085005f","Type":"ContainerDied","Data":"d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5"}
Jul 07 11:32:21.598469 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.598400    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f86dc9889-ss6pj" event={"ID":"da091e3f-541c-4b76-9da4-0ddb4085005f","Type":"ContainerDied","Data":"8f4a099f22f7543dbaf186f08e86117f97fac739809f76e55f2909a4ed51fdbf"}
Jul 07 11:32:21.598469 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.598447    2564 scope.go:117] "RemoveContainer" containerID="d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5"
Jul 07 11:32:21.601484 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.601457    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds"
Jul 07 11:32:21.601849 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.601772    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" event={"ID":"32fac2e8-b811-41d9-85e0-2eed643230c1","Type":"ContainerStarted","Data":"8b5aeec5826cba6aa389a0dc308f7db790f809c81a3c85681dccc884107ec5a3"}
Jul 07 11:32:21.612800 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.612746    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mllw2" podStartSLOduration=34.194416762 podStartE2EDuration="51.61272689s" totalImagesPullingTime="17.418310128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:31:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:21.610904014 +0000 UTC m=+324.650128714" watchObservedRunningTime="2026-07-07 11:32:21.61272689 +0000 UTC m=+324.651951593"
Jul 07 11:32:21.628754 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.627011    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z7bds" podStartSLOduration=2.552074847 podStartE2EDuration="6.626994082s" totalImagesPullingTime="4.074919235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:21.626422797 +0000 UTC m=+324.665647499" watchObservedRunningTime="2026-07-07 11:32:21.626994082 +0000 UTC m=+324.666218784"
Jul 07 11:32:21.645878 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.645798    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f86dc9889-ss6pj"]
Jul 07 11:32:21.653562 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.653533    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f86dc9889-ss6pj"]
Jul 07 11:32:21.886510 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.886485    2564 scope.go:117] "RemoveContainer" containerID="d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5"
Jul 07 11:32:21.887088 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:32:21.886960    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5\": container with ID starting with d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5 not found: ID does not exist" containerID="d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5"
Jul 07 11:32:21.887088 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:21.886996    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5"} err="failed to get container status \"d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5\": rpc error: code = NotFound desc = could not find container \"d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5\": container with ID starting with d8522d5fb96e467a9b691110a01b980b9247366195e7aa4991b61712f73439a5 not found: ID does not exist"
Jul 07 11:32:22.610564 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:22.610528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerStarted","Data":"9b7a0b15e2356023ecb1cdfc8e8427ba2bfab41aea62c21b50dd55b576e8157c"}
Jul 07 11:32:22.611034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:22.610616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerStarted","Data":"36dba89638c2c568aa2f8a0a3fd4ac7565911f68c858143ee832a0a787c14949"}
Jul 07 11:32:22.613070 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:22.613029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" event={"ID":"32fac2e8-b811-41d9-85e0-2eed643230c1","Type":"ContainerStarted","Data":"3c44a800c59e7ad1f0a645f08016f9cd264f5c99108e55f223e4037680bc0d57"}
Jul 07 11:32:22.613219 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:22.613116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" event={"ID":"32fac2e8-b811-41d9-85e0-2eed643230c1","Type":"ContainerStarted","Data":"fbea15f5f018e04ee361674cc3cb35f7602a885452fe990b90ee0e372a0fb6bb"}
Jul 07 11:32:22.614942 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:22.614910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78998f6486-8gxkr" event={"ID":"4b885f90-9457-4a11-afc6-0c78985e1f3e","Type":"ContainerStarted","Data":"1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47"}
Jul 07 11:32:23.418927 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:23.418892    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da091e3f-541c-4b76-9da4-0ddb4085005f" path="/var/lib/kubelet/pods/da091e3f-541c-4b76-9da4-0ddb4085005f/volumes"
Jul 07 11:32:23.623889 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:23.623849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerStarted","Data":"11a834d2ecf6e5c466e6fe2718e3b819862070c0da18ba3ef48821848d6b997a"}
Jul 07 11:32:23.624321 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:23.623932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerStarted","Data":"9aa498d39245e5e5b936253496342fd3f97c129d22cfb632f7c8c5f90e5f8fc7"}
Jul 07 11:32:23.624321 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:23.623978    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerStarted","Data":"79f1e7e4ea617318414e1d33e27bf0125c7e94fa268e6ce6545a014fe276d975"}
Jul 07 11:32:24.631093 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.631054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"44994288-e290-43cd-bbd1-51940a28251d","Type":"ContainerStarted","Data":"5f55796354e8d10db0366dda8b77e629c9894c72b755d3dc8b5d65ba7b60bbb9"}
Jul 07 11:32:24.634124 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.634097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" event={"ID":"32fac2e8-b811-41d9-85e0-2eed643230c1","Type":"ContainerStarted","Data":"c83a62df74869de8e25bc2ef4bee8da48e12abb2bfd2de6b016df3aa52258077"}
Jul 07 11:32:24.634263 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.634158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" event={"ID":"32fac2e8-b811-41d9-85e0-2eed643230c1","Type":"ContainerStarted","Data":"5dd0e9797cf3bcf498804c4c0c8e7d068a9e72b267562373c2c0e5cf1800a0bf"}
Jul 07 11:32:24.634263 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.634191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" event={"ID":"32fac2e8-b811-41d9-85e0-2eed643230c1","Type":"ContainerStarted","Data":"98b5dd213774b401b892b6fdc98fc409d809400b91b58036866de2f57f885ba8"}
Jul 07 11:32:24.634263 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.634242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:24.661837 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.661788    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.836100154 podStartE2EDuration="13.661771599s" totalImagesPullingTime="7.802969346s" totalInitContainerRuntime="22.702099ms" isStatefulPod=false podCreationTimestamp="2026-07-07 11:32:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:24.660155172 +0000 UTC m=+327.699379874" watchObservedRunningTime="2026-07-07 11:32:24.661771599 +0000 UTC m=+327.700996378"
Jul 07 11:32:24.662019 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.661961    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78998f6486-8gxkr" podStartSLOduration=7.661953266 podStartE2EDuration="7.661953266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:22.641029357 +0000 UTC m=+325.680254059" watchObservedRunningTime="2026-07-07 11:32:24.661953266 +0000 UTC m=+327.701178000"
Jul 07 11:32:24.683750 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:24.683689    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2" podStartSLOduration=3.106000481 podStartE2EDuration="10.68367257s" totalImagesPullingTime="7.577672089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:32:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:32:24.682937491 +0000 UTC m=+327.722162192" watchObservedRunningTime="2026-07-07 11:32:24.68367257 +0000 UTC m=+327.722897272"
Jul 07 11:32:27.841815 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:27.841772    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:27.842207 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:27.841836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:27.846830 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:27.846803    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:28.624957 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:28.624915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:28.657135 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:28.657108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:32:28.707389 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:28.707357    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654cfc96b5-g5rpn"]
Jul 07 11:32:28.711985 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:28.711953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:28.832766 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:28.832730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:28.936749 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:28.936712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:29.034371 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:29.034334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:29.144315 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:29.144276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:29.212129 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:29.212045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:30.644762 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:30.644727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-786954f874-jzzw2"
Jul 07 11:32:43.624336 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:43.624304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:43.683604 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:43.683573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:45.720503 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:45.720470    2564 generic.go:356] "Generic (PLEG): container finished" podID="43389efd-5b7c-4452-9af6-db603e7a8d69" containerID="7a971bd78cdbd253a1c109f575e0389493d317264879e33452e29a9c2b68f5ee" exitCode=0
Jul 07 11:32:45.720917 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:45.720526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm" event={"ID":"43389efd-5b7c-4452-9af6-db603e7a8d69","Type":"ContainerDied","Data":"7a971bd78cdbd253a1c109f575e0389493d317264879e33452e29a9c2b68f5ee"}
Jul 07 11:32:45.720956 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:45.720925    2564 scope.go:117] "RemoveContainer" containerID="7a971bd78cdbd253a1c109f575e0389493d317264879e33452e29a9c2b68f5ee"
Jul 07 11:32:46.725924 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:46.725890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vxqdm" event={"ID":"43389efd-5b7c-4452-9af6-db603e7a8d69","Type":"ContainerStarted","Data":"8462d9213dfcf8c091756fdcb00a66285ab1393a73710d12db418a023fca1f99"}
Jul 07 11:32:53.729859 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:53.729739    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-654cfc96b5-g5rpn" podUID="4203968b-ece0-4229-8336-cd6acccee961" containerName="console" containerID="cri-o://9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c" gracePeriod=15
Jul 07 11:32:54.007002 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.006912    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:32:54.124547 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.124503    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-serving-cert\") pod \"4203968b-ece0-4229-8336-cd6acccee961\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") "
Jul 07 11:32:54.124783 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.124572    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-oauth-serving-cert\") pod \"4203968b-ece0-4229-8336-cd6acccee961\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") "
Jul 07 11:32:54.124783 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.124666    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d65ld\" (UniqueName: \"kubernetes.io/projected/4203968b-ece0-4229-8336-cd6acccee961-kube-api-access-d65ld\") pod \"4203968b-ece0-4229-8336-cd6acccee961\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") "
Jul 07 11:32:54.124783 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.124696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-service-ca\") pod \"4203968b-ece0-4229-8336-cd6acccee961\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") "
Jul 07 11:32:54.124783 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.124726    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-oauth-config\") pod \"4203968b-ece0-4229-8336-cd6acccee961\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") "
Jul 07 11:32:54.124783 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.124748    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-console-config\") pod \"4203968b-ece0-4229-8336-cd6acccee961\" (UID: \"4203968b-ece0-4229-8336-cd6acccee961\") "
Jul 07 11:32:54.125050 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.125016    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4203968b-ece0-4229-8336-cd6acccee961" (UID: "4203968b-ece0-4229-8336-cd6acccee961"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:32:54.125113 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.125073    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-service-ca" (OuterVolumeSpecName: "service-ca") pod "4203968b-ece0-4229-8336-cd6acccee961" (UID: "4203968b-ece0-4229-8336-cd6acccee961"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:32:54.125227 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.125189    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-console-config" (OuterVolumeSpecName: "console-config") pod "4203968b-ece0-4229-8336-cd6acccee961" (UID: "4203968b-ece0-4229-8336-cd6acccee961"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:32:54.127140 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.127115    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4203968b-ece0-4229-8336-cd6acccee961" (UID: "4203968b-ece0-4229-8336-cd6acccee961"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:32:54.127242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.127143    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4203968b-ece0-4229-8336-cd6acccee961" (UID: "4203968b-ece0-4229-8336-cd6acccee961"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:32:54.127242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.127159    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4203968b-ece0-4229-8336-cd6acccee961-kube-api-access-d65ld" (OuterVolumeSpecName: "kube-api-access-d65ld") pod "4203968b-ece0-4229-8336-cd6acccee961" (UID: "4203968b-ece0-4229-8336-cd6acccee961"). InnerVolumeSpecName "kube-api-access-d65ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:32:54.225817 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.225780    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d65ld\" (UniqueName: \"kubernetes.io/projected/4203968b-ece0-4229-8336-cd6acccee961-kube-api-access-d65ld\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:54.225817 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.225812    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:54.225817 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.225821    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:54.226047 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.225830    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:54.226047 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.225839    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4203968b-ece0-4229-8336-cd6acccee961-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:54.226047 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.225847    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4203968b-ece0-4229-8336-cd6acccee961-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:32:54.759808 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.759770    2564 generic.go:356] "Generic (PLEG): container finished" podID="4203968b-ece0-4229-8336-cd6acccee961" containerID="9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c" exitCode=0
Jul 07 11:32:54.760250 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.759817    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654cfc96b5-g5rpn"
Jul 07 11:32:54.760250 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.759851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654cfc96b5-g5rpn" event={"ID":"4203968b-ece0-4229-8336-cd6acccee961","Type":"ContainerDied","Data":"9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c"}
Jul 07 11:32:54.760250 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.759939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654cfc96b5-g5rpn" event={"ID":"4203968b-ece0-4229-8336-cd6acccee961","Type":"ContainerDied","Data":"219a4b67ffb2204248a3624eecb864339734a972b71e9067274117418b3045a3"}
Jul 07 11:32:54.760250 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.759961    2564 scope.go:117] "RemoveContainer" containerID="9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c"
Jul 07 11:32:54.768821 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.768797    2564 scope.go:117] "RemoveContainer" containerID="9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c"
Jul 07 11:32:54.769125 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:32:54.769108    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c\": container with ID starting with 9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c not found: ID does not exist" containerID="9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c"
Jul 07 11:32:54.769174 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.769136    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c"} err="failed to get container status \"9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c\": rpc error: code = NotFound desc = could not find container \"9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c\": container with ID starting with 9384419d27af786396560226078bcc5af0241b1f53c900615ecde3a710ac5d6c not found: ID does not exist"
Jul 07 11:32:54.781533 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.781497    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654cfc96b5-g5rpn"]
Jul 07 11:32:54.787244 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:54.787214    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-654cfc96b5-g5rpn"]
Jul 07 11:32:55.418099 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:55.418059    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4203968b-ece0-4229-8336-cd6acccee961" path="/var/lib/kubelet/pods/4203968b-ece0-4229-8336-cd6acccee961/volumes"
Jul 07 11:32:58.562318 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:58.562287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:58.664055 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:58.664014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:32:58.732504 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:32:58.732470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:00.339371 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:00.339335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:00.399301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:00.399245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:02.600015 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:02.599982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:02.700845 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:02.700810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:02.757483 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:02.757450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:05.662446 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:05.662356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:05.713863 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:05.713815    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:05.802851 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:05.802810    2564 generic.go:356] "Generic (PLEG): container finished" podID="eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e" containerID="93a15baeaf941ec0864f0feed7ab16f2a266df5f7ce68785dfbd4660a50fbe33" exitCode=0
Jul 07 11:33:05.803057 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:05.802899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl" event={"ID":"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e","Type":"ContainerDied","Data":"93a15baeaf941ec0864f0feed7ab16f2a266df5f7ce68785dfbd4660a50fbe33"}
Jul 07 11:33:05.803312 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:05.803285    2564 scope.go:117] "RemoveContainer" containerID="93a15baeaf941ec0864f0feed7ab16f2a266df5f7ce68785dfbd4660a50fbe33"
Jul 07 11:33:06.809049 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:06.809015    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-ctpkl" event={"ID":"eb6efa5b-75cf-4233-b2d9-b57a2bf29c8e","Type":"ContainerStarted","Data":"105c57b791fa271f2cadf803086f0b439b72ad00805d1ae792671ca796d4d0f8"}
Jul 07 11:33:10.250354 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.250321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:10.350903 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.350857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:10.372970 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.372933    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:33:10.375399 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.375377    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f1eb45a-97c2-44fa-b2e8-4fde56f08886-metrics-certs\") pod \"network-metrics-daemon-s5js2\" (UID: \"5f1eb45a-97c2-44fa-b2e8-4fde56f08886\") " pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:33:10.516609 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.516518    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfmsb\""
Jul 07 11:33:10.523929 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.523904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5js2"
Jul 07 11:33:10.659322 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.659131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s5js2"]
Jul 07 11:33:10.661903 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:33:10.661869    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1eb45a_97c2_44fa_b2e8_4fde56f08886.slice/crio-bf98e59cad7272afb3043cd37a9985c2ea1155cabfe0ba330f5988e06cb83ef2 WatchSource:0}: Error finding container bf98e59cad7272afb3043cd37a9985c2ea1155cabfe0ba330f5988e06cb83ef2: Status 404 returned error can't find the container with id bf98e59cad7272afb3043cd37a9985c2ea1155cabfe0ba330f5988e06cb83ef2
Jul 07 11:33:10.830146 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:10.830057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5js2" event={"ID":"5f1eb45a-97c2-44fa-b2e8-4fde56f08886","Type":"ContainerStarted","Data":"bf98e59cad7272afb3043cd37a9985c2ea1155cabfe0ba330f5988e06cb83ef2"}
Jul 07 11:33:12.839578 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:12.839540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5js2" event={"ID":"5f1eb45a-97c2-44fa-b2e8-4fde56f08886","Type":"ContainerStarted","Data":"5b08fa81f03e248f34547230b8ad839bf0a1317c2a17ca56da8eeab7ccd98a58"}
Jul 07 11:33:12.840005 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:12.839603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5js2" event={"ID":"5f1eb45a-97c2-44fa-b2e8-4fde56f08886","Type":"ContainerStarted","Data":"fa557d4be2868ec7513da58c42da7941ebbb2d60d473e11222d3bc4ae36d2e8c"}
Jul 07 11:33:12.858044 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:12.857991    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s5js2" podStartSLOduration=374.570147503 podStartE2EDuration="6m15.857975011s" totalImagesPullingTime="1.287827508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:33:12.857221453 +0000 UTC m=+375.896446155" watchObservedRunningTime="2026-07-07 11:33:12.857975011 +0000 UTC m=+375.897199712"
Jul 07 11:33:12.953087 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:12.953043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:13.010743 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:13.010706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:22.282250 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:22.282213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:22.384720 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:22.384676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:29.693069 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:29.693031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:29.990329 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:29.990229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:34.858541 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.858506    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"]
Jul 07 11:33:34.858932 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.858847    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da091e3f-541c-4b76-9da4-0ddb4085005f" containerName="registry"
Jul 07 11:33:34.858932 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.858858    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="da091e3f-541c-4b76-9da4-0ddb4085005f" containerName="registry"
Jul 07 11:33:34.858932 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.858868    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4203968b-ece0-4229-8336-cd6acccee961" containerName="console"
Jul 07 11:33:34.858932 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.858873    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4203968b-ece0-4229-8336-cd6acccee961" containerName="console"
Jul 07 11:33:34.859056 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.858940    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="da091e3f-541c-4b76-9da4-0ddb4085005f" containerName="registry"
Jul 07 11:33:34.859056 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.858951    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4203968b-ece0-4229-8336-cd6acccee961" containerName="console"
Jul 07 11:33:34.862504 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.862487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.869728 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.869707    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 11:33:34.870501 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.870482    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 11:33:34.870602 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.870586    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 11:33:34.870987 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.870973    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-25hxj\""
Jul 07 11:33:34.871495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.871478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 11:33:34.872564 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.872550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 11:33:34.877563 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.877546    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 11:33:34.882536 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.882517    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"]
Jul 07 11:33:34.969350 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpnhb\" (UniqueName: \"kubernetes.io/projected/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-kube-api-access-vpnhb\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.969492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-serving-certs-ca-bundle\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.969492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-secret-telemeter-client\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.969492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-telemeter-client-tls\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.969492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-federate-client-tls\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.969654 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.969654 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:34.969654 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:34.969537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-metrics-client-ca\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070713 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-secret-telemeter-client\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070713 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-telemeter-client-tls\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-federate-client-tls\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-metrics-client-ca\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpnhb\" (UniqueName: \"kubernetes.io/projected/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-kube-api-access-vpnhb\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.070966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.070946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-serving-certs-ca-bundle\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.071733 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.071700    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-metrics-client-ca\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.071858 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.071776    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-serving-certs-ca-bundle\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.071858 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.071794    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.074029 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.074001    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.074118 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.074092    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-telemeter-client-tls\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.074191 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.074171    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-secret-telemeter-client\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.074366 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.074349    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-federate-client-tls\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.081283 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.081258    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpnhb\" (UniqueName: \"kubernetes.io/projected/fe87c6bb-4aee-4caf-8f8a-0dad72036f9e-kube-api-access-vpnhb\") pod \"telemeter-client-dfcbb9b57-xl92w\" (UID: \"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e\") " pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.171881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.171852    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"
Jul 07 11:33:35.324313 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.324278    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-dfcbb9b57-xl92w"]
Jul 07 11:33:35.324899 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:33:35.324873    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe87c6bb_4aee_4caf_8f8a_0dad72036f9e.slice/crio-a94f4245290fbb3c0bd3fcce115afa74f0039dff47ae27c7fe69d516c5b1c676 WatchSource:0}: Error finding container a94f4245290fbb3c0bd3fcce115afa74f0039dff47ae27c7fe69d516c5b1c676: Status 404 returned error can't find the container with id a94f4245290fbb3c0bd3fcce115afa74f0039dff47ae27c7fe69d516c5b1c676
Jul 07 11:33:35.938364 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:35.938328    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w" event={"ID":"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e","Type":"ContainerStarted","Data":"a94f4245290fbb3c0bd3fcce115afa74f0039dff47ae27c7fe69d516c5b1c676"}
Jul 07 11:33:37.948318 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:37.948268    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w" event={"ID":"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e","Type":"ContainerStarted","Data":"8ddca0eb9cf46001ebc3a02c67836a9cc55061a17559f513d837161057919934"}
Jul 07 11:33:37.948773 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:37.948377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w" event={"ID":"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e","Type":"ContainerStarted","Data":"ae8662f57c1f9df24953e1f2dae576a976e4be6bdd4515e96f3c6455a3797b49"}
Jul 07 11:33:37.948773 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:37.948412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w" event={"ID":"fe87c6bb-4aee-4caf-8f8a-0dad72036f9e","Type":"ContainerStarted","Data":"881716305d234cf57058725af37f077d18175030e7e7810b58118a48f68b0dfa"}
Jul 07 11:33:37.987540 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:37.987471    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-dfcbb9b57-xl92w" podStartSLOduration=1.904298393 podStartE2EDuration="3.987454388s" totalImagesPullingTime="2.083155995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:33:37.986562076 +0000 UTC m=+401.025786776" watchObservedRunningTime="2026-07-07 11:33:37.987454388 +0000 UTC m=+401.026679098"
Jul 07 11:33:38.699156 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.699118    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-866d8549cb-b82n9"]
Jul 07 11:33:38.701521 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.701505    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.717312 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.717282    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866d8549cb-b82n9"]
Jul 07 11:33:38.772009 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.771973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:38.805319 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.805288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-serving-cert\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.805471 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.805331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwgsl\" (UniqueName: \"kubernetes.io/projected/86878aec-9d6b-45e3-9d26-4d3443009ce5-kube-api-access-cwgsl\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.805471 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.805356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-trusted-ca-bundle\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.805471 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.805379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-config\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.805471 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.805407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-service-ca\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.805471 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.805456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-oauth-serving-cert\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.805690 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.805479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-oauth-config\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.837900 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.837861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:38.906851 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.906811    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-oauth-serving-cert\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907013 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.906861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-oauth-config\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907013 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.906908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-serving-cert\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907013 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.906923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwgsl\" (UniqueName: \"kubernetes.io/projected/86878aec-9d6b-45e3-9d26-4d3443009ce5-kube-api-access-cwgsl\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907013 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.906946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-trusted-ca-bundle\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907013 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.906976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-config\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907244 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.907000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-service-ca\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907761 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.907732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-oauth-serving-cert\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907761 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.907755    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-service-ca\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907897 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.907732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-config\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.907897 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.907793    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-trusted-ca-bundle\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.910092 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.910076    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-serving-cert\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.910227 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.910209    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-oauth-config\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:38.916612 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:38.916587    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwgsl\" (UniqueName: \"kubernetes.io/projected/86878aec-9d6b-45e3-9d26-4d3443009ce5-kube-api-access-cwgsl\") pod \"console-866d8549cb-b82n9\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") " pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:39.011326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:39.011248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:39.150086 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:39.150062    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866d8549cb-b82n9"]
Jul 07 11:33:39.152697 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:33:39.152666    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86878aec_9d6b_45e3_9d26_4d3443009ce5.slice/crio-19df5249cc57d78e7f478c402965d13dd144e71a441cb04649642c72207230f9 WatchSource:0}: Error finding container 19df5249cc57d78e7f478c402965d13dd144e71a441cb04649642c72207230f9: Status 404 returned error can't find the container with id 19df5249cc57d78e7f478c402965d13dd144e71a441cb04649642c72207230f9
Jul 07 11:33:39.958480 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:39.958447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866d8549cb-b82n9" event={"ID":"86878aec-9d6b-45e3-9d26-4d3443009ce5","Type":"ContainerStarted","Data":"254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb"}
Jul 07 11:33:39.958678 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:39.958492    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866d8549cb-b82n9" event={"ID":"86878aec-9d6b-45e3-9d26-4d3443009ce5","Type":"ContainerStarted","Data":"19df5249cc57d78e7f478c402965d13dd144e71a441cb04649642c72207230f9"}
Jul 07 11:33:39.979122 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:39.979065    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-866d8549cb-b82n9" podStartSLOduration=1.9790485740000001 podStartE2EDuration="1.979048574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:33:39.977528341 +0000 UTC m=+403.016753039" watchObservedRunningTime="2026-07-07 11:33:39.979048574 +0000 UTC m=+403.018273275"
Jul 07 11:33:44.404873 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:44.404835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:44.463593 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:44.463557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:45.007482 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:45.007434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:45.077047 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:45.077014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:45.597415 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:45.597379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:49.011581 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:49.011533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:49.012073 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:49.011624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:49.016513 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:49.016488    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:50.005471 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.005439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:33:50.048387 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.048356    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78998f6486-8gxkr"]
Jul 07 11:33:50.112832 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.112799    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58645b9448-h6rlw"]
Jul 07 11:33:50.115424 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.115404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.127391 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.127357    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58645b9448-h6rlw"]
Jul 07 11:33:50.208419 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.208380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-oauth-serving-cert\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.208419 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.208416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-service-ca\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.208653 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.208443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-config\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.208653 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.208515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-trusted-ca-bundle\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.208653 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.208550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-serving-cert\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.208653 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.208605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-oauth-config\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.208653 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.208621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k25xm\" (UniqueName: \"kubernetes.io/projected/1d280b57-2aed-4010-ac4c-3f7f5a45379d-kube-api-access-k25xm\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.309968 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.309877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-trusted-ca-bundle\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.309968 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.309924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-serving-cert\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.309968 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.309971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-oauth-config\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.310223 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.309988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k25xm\" (UniqueName: \"kubernetes.io/projected/1d280b57-2aed-4010-ac4c-3f7f5a45379d-kube-api-access-k25xm\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.310223 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.310013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-oauth-serving-cert\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.310223 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.310038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-service-ca\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.310223 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.310072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-config\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.310867 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.310845    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-config\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.310984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.310919    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-service-ca\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.311052 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.311025    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-oauth-serving-cert\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.311211 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.311188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-trusted-ca-bundle\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.312772 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.312747    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-oauth-config\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.312889 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.312873    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-serving-cert\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.318797 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.318773    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k25xm\" (UniqueName: \"kubernetes.io/projected/1d280b57-2aed-4010-ac4c-3f7f5a45379d-kube-api-access-k25xm\") pod \"console-58645b9448-h6rlw\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") " pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.425082 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.425031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:33:50.563249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:50.563218    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58645b9448-h6rlw"]
Jul 07 11:33:50.565846 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:33:50.565817    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d280b57_2aed_4010_ac4c_3f7f5a45379d.slice/crio-90ccaddba18078de9a835d7103034d1b1ba9de432022e2cdb0dcc8ce989ae581 WatchSource:0}: Error finding container 90ccaddba18078de9a835d7103034d1b1ba9de432022e2cdb0dcc8ce989ae581: Status 404 returned error can't find the container with id 90ccaddba18078de9a835d7103034d1b1ba9de432022e2cdb0dcc8ce989ae581
Jul 07 11:33:51.011995 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:51.011939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58645b9448-h6rlw" event={"ID":"1d280b57-2aed-4010-ac4c-3f7f5a45379d","Type":"ContainerStarted","Data":"7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac"}
Jul 07 11:33:51.012215 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:51.012087    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58645b9448-h6rlw" event={"ID":"1d280b57-2aed-4010-ac4c-3f7f5a45379d","Type":"ContainerStarted","Data":"90ccaddba18078de9a835d7103034d1b1ba9de432022e2cdb0dcc8ce989ae581"}
Jul 07 11:33:51.032290 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:51.032229    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58645b9448-h6rlw" podStartSLOduration=1.0322108700000001 podStartE2EDuration="1.03221087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:33:51.029927556 +0000 UTC m=+414.069152257" watchObservedRunningTime="2026-07-07 11:33:51.03221087 +0000 UTC m=+414.071435570"
Jul 07 11:33:56.940050 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:56.940015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:33:56.996349 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:33:56.996314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:00.425899 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:00.425850    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:34:00.426280 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:00.425922    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:34:00.430871 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:00.430841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:34:01.062380 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:01.062346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:34:01.111330 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:01.111289    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-866d8549cb-b82n9"]
Jul 07 11:34:01.207172 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:01.207124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:01.308219 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:01.308181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:01.409002 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:01.408916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:03.434945 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:03.434899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:03.501502 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:03.501465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:13.645111 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:13.645056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:13.753388 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:13.753347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:15.070764 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.070720    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78998f6486-8gxkr" podUID="4b885f90-9457-4a11-afc6-0c78985e1f3e" containerName="console" containerID="cri-o://1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47" gracePeriod=15
Jul 07 11:34:15.319106 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.319080    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:34:15.327685 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.327624    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-config\") pod \"4b885f90-9457-4a11-afc6-0c78985e1f3e\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") "
Jul 07 11:34:15.327763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.327687    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-trusted-ca-bundle\") pod \"4b885f90-9457-4a11-afc6-0c78985e1f3e\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") "
Jul 07 11:34:15.327763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.327709    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-oauth-config\") pod \"4b885f90-9457-4a11-afc6-0c78985e1f3e\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") "
Jul 07 11:34:15.327763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.327726    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-service-ca\") pod \"4b885f90-9457-4a11-afc6-0c78985e1f3e\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") "
Jul 07 11:34:15.327763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.327741    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-oauth-serving-cert\") pod \"4b885f90-9457-4a11-afc6-0c78985e1f3e\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") "
Jul 07 11:34:15.327952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.327784    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b9ml\" (UniqueName: \"kubernetes.io/projected/4b885f90-9457-4a11-afc6-0c78985e1f3e-kube-api-access-5b9ml\") pod \"4b885f90-9457-4a11-afc6-0c78985e1f3e\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") "
Jul 07 11:34:15.327952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.327823    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-serving-cert\") pod \"4b885f90-9457-4a11-afc6-0c78985e1f3e\" (UID: \"4b885f90-9457-4a11-afc6-0c78985e1f3e\") "
Jul 07 11:34:15.328039 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.328016    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-config" (OuterVolumeSpecName: "console-config") pod "4b885f90-9457-4a11-afc6-0c78985e1f3e" (UID: "4b885f90-9457-4a11-afc6-0c78985e1f3e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:15.328274 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.328237    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4b885f90-9457-4a11-afc6-0c78985e1f3e" (UID: "4b885f90-9457-4a11-afc6-0c78985e1f3e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:15.328345 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.328276    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:15.328345 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.328276    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4b885f90-9457-4a11-afc6-0c78985e1f3e" (UID: "4b885f90-9457-4a11-afc6-0c78985e1f3e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:15.328421 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.328402    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-service-ca" (OuterVolumeSpecName: "service-ca") pod "4b885f90-9457-4a11-afc6-0c78985e1f3e" (UID: "4b885f90-9457-4a11-afc6-0c78985e1f3e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:15.330151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.330124    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4b885f90-9457-4a11-afc6-0c78985e1f3e" (UID: "4b885f90-9457-4a11-afc6-0c78985e1f3e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:34:15.330242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.330220    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4b885f90-9457-4a11-afc6-0c78985e1f3e" (UID: "4b885f90-9457-4a11-afc6-0c78985e1f3e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:34:15.330242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.330229    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b885f90-9457-4a11-afc6-0c78985e1f3e-kube-api-access-5b9ml" (OuterVolumeSpecName: "kube-api-access-5b9ml") pod "4b885f90-9457-4a11-afc6-0c78985e1f3e" (UID: "4b885f90-9457-4a11-afc6-0c78985e1f3e"). InnerVolumeSpecName "kube-api-access-5b9ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:34:15.429333 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.429308    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b9ml\" (UniqueName: \"kubernetes.io/projected/4b885f90-9457-4a11-afc6-0c78985e1f3e-kube-api-access-5b9ml\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:15.429333 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.429333    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:15.429521 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.429346    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:15.429521 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.429360    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b885f90-9457-4a11-afc6-0c78985e1f3e-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:15.429521 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.429373    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:15.429521 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:15.429384    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b885f90-9457-4a11-afc6-0c78985e1f3e-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:16.122187 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.122144    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b885f90-9457-4a11-afc6-0c78985e1f3e" containerID="1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47" exitCode=0
Jul 07 11:34:16.122187 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.122191    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78998f6486-8gxkr"
Jul 07 11:34:16.122656 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.122221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78998f6486-8gxkr" event={"ID":"4b885f90-9457-4a11-afc6-0c78985e1f3e","Type":"ContainerDied","Data":"1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47"}
Jul 07 11:34:16.122656 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.122265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78998f6486-8gxkr" event={"ID":"4b885f90-9457-4a11-afc6-0c78985e1f3e","Type":"ContainerDied","Data":"181e57515d2cf998e2467f7f0f4876cde4a30d8ca24405505b40fa267120d2c2"}
Jul 07 11:34:16.122656 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.122288    2564 scope.go:117] "RemoveContainer" containerID="1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47"
Jul 07 11:34:16.131381 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.131361    2564 scope.go:117] "RemoveContainer" containerID="1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47"
Jul 07 11:34:16.131616 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:34:16.131597    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47\": container with ID starting with 1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47 not found: ID does not exist" containerID="1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47"
Jul 07 11:34:16.131692 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.131648    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47"} err="failed to get container status \"1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47\": rpc error: code = NotFound desc = could not find container \"1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47\": container with ID starting with 1e7ccaded0009fd42a71348d5f3bb8b0e78819a80935ba22caafd99b93647a47 not found: ID does not exist"
Jul 07 11:34:16.140918 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.140890    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78998f6486-8gxkr"]
Jul 07 11:34:16.145352 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:16.145331    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78998f6486-8gxkr"]
Jul 07 11:34:17.417495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:17.417455    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b885f90-9457-4a11-afc6-0c78985e1f3e" path="/var/lib/kubelet/pods/4b885f90-9457-4a11-afc6-0c78985e1f3e/volumes"
Jul 07 11:34:26.140207 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.140158    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-866d8549cb-b82n9" podUID="86878aec-9d6b-45e3-9d26-4d3443009ce5" containerName="console" containerID="cri-o://254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb" gracePeriod=15
Jul 07 11:34:26.396003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.395938    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:34:26.423676 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.423648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-config\") pod \"86878aec-9d6b-45e3-9d26-4d3443009ce5\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") "
Jul 07 11:34:26.423860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.423685    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-oauth-config\") pod \"86878aec-9d6b-45e3-9d26-4d3443009ce5\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") "
Jul 07 11:34:26.423860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.423708    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-trusted-ca-bundle\") pod \"86878aec-9d6b-45e3-9d26-4d3443009ce5\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") "
Jul 07 11:34:26.423860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.423728    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-oauth-serving-cert\") pod \"86878aec-9d6b-45e3-9d26-4d3443009ce5\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") "
Jul 07 11:34:26.424017 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.423902    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwgsl\" (UniqueName: \"kubernetes.io/projected/86878aec-9d6b-45e3-9d26-4d3443009ce5-kube-api-access-cwgsl\") pod \"86878aec-9d6b-45e3-9d26-4d3443009ce5\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") "
Jul 07 11:34:26.424017 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.423949    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-service-ca\") pod \"86878aec-9d6b-45e3-9d26-4d3443009ce5\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") "
Jul 07 11:34:26.424017 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.423994    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-serving-cert\") pod \"86878aec-9d6b-45e3-9d26-4d3443009ce5\" (UID: \"86878aec-9d6b-45e3-9d26-4d3443009ce5\") "
Jul 07 11:34:26.424191 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.424165    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86878aec-9d6b-45e3-9d26-4d3443009ce5" (UID: "86878aec-9d6b-45e3-9d26-4d3443009ce5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:26.424254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.424215    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86878aec-9d6b-45e3-9d26-4d3443009ce5" (UID: "86878aec-9d6b-45e3-9d26-4d3443009ce5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:26.424313 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.424294    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:26.424369 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.424313    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:26.424369 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.424347    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-service-ca" (OuterVolumeSpecName: "service-ca") pod "86878aec-9d6b-45e3-9d26-4d3443009ce5" (UID: "86878aec-9d6b-45e3-9d26-4d3443009ce5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:26.424533 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.424502    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-config" (OuterVolumeSpecName: "console-config") pod "86878aec-9d6b-45e3-9d26-4d3443009ce5" (UID: "86878aec-9d6b-45e3-9d26-4d3443009ce5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:34:26.426408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.426378    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86878aec-9d6b-45e3-9d26-4d3443009ce5-kube-api-access-cwgsl" (OuterVolumeSpecName: "kube-api-access-cwgsl") pod "86878aec-9d6b-45e3-9d26-4d3443009ce5" (UID: "86878aec-9d6b-45e3-9d26-4d3443009ce5"). InnerVolumeSpecName "kube-api-access-cwgsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:34:26.426711 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.426693    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86878aec-9d6b-45e3-9d26-4d3443009ce5" (UID: "86878aec-9d6b-45e3-9d26-4d3443009ce5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:34:26.426826 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.426721    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86878aec-9d6b-45e3-9d26-4d3443009ce5" (UID: "86878aec-9d6b-45e3-9d26-4d3443009ce5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:34:26.524732 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.524695    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:26.524732 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.524724    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:26.524732 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.524735    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwgsl\" (UniqueName: \"kubernetes.io/projected/86878aec-9d6b-45e3-9d26-4d3443009ce5-kube-api-access-cwgsl\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:26.524732 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.524745    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86878aec-9d6b-45e3-9d26-4d3443009ce5-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:26.525002 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:26.524754    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86878aec-9d6b-45e3-9d26-4d3443009ce5-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:34:27.174061 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.174025    2564 generic.go:356] "Generic (PLEG): container finished" podID="86878aec-9d6b-45e3-9d26-4d3443009ce5" containerID="254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb" exitCode=0
Jul 07 11:34:27.174513 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.174075    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866d8549cb-b82n9"
Jul 07 11:34:27.174513 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.174110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866d8549cb-b82n9" event={"ID":"86878aec-9d6b-45e3-9d26-4d3443009ce5","Type":"ContainerDied","Data":"254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb"}
Jul 07 11:34:27.174513 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.174161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866d8549cb-b82n9" event={"ID":"86878aec-9d6b-45e3-9d26-4d3443009ce5","Type":"ContainerDied","Data":"19df5249cc57d78e7f478c402965d13dd144e71a441cb04649642c72207230f9"}
Jul 07 11:34:27.174513 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.174182    2564 scope.go:117] "RemoveContainer" containerID="254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb"
Jul 07 11:34:27.183302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.183282    2564 scope.go:117] "RemoveContainer" containerID="254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb"
Jul 07 11:34:27.183583 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:34:27.183565    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb\": container with ID starting with 254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb not found: ID does not exist" containerID="254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb"
Jul 07 11:34:27.183671 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.183596    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb"} err="failed to get container status \"254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb\": rpc error: code = NotFound desc = could not find container \"254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb\": container with ID starting with 254f381f8c8c0b3cfd3d4c616997589119de16f75536e051e648b799cf0dcffb not found: ID does not exist"
Jul 07 11:34:27.196838 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.196807    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-866d8549cb-b82n9"]
Jul 07 11:34:27.201036 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.201007    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-866d8549cb-b82n9"]
Jul 07 11:34:27.416912 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:27.416881    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86878aec-9d6b-45e3-9d26-4d3443009ce5" path="/var/lib/kubelet/pods/86878aec-9d6b-45e3-9d26-4d3443009ce5/volumes"
Jul 07 11:34:35.803348 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:35.803307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:34:35.867262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:34:35.867223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:01.505884 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:01.505846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:01.609582 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:01.609361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:28.428410 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:28.428371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:29.828019 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:29.827988    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:30.386404 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.386373    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"]
Jul 07 11:35:30.386748 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.386735    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b885f90-9457-4a11-afc6-0c78985e1f3e" containerName="console"
Jul 07 11:35:30.386795 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.386750    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b885f90-9457-4a11-afc6-0c78985e1f3e" containerName="console"
Jul 07 11:35:30.386795 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.386766    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86878aec-9d6b-45e3-9d26-4d3443009ce5" containerName="console"
Jul 07 11:35:30.386795 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.386772    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="86878aec-9d6b-45e3-9d26-4d3443009ce5" containerName="console"
Jul 07 11:35:30.386891 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.386828    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b885f90-9457-4a11-afc6-0c78985e1f3e" containerName="console"
Jul 07 11:35:30.386891 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.386836    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="86878aec-9d6b-45e3-9d26-4d3443009ce5" containerName="console"
Jul 07 11:35:30.389798 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.389779    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.393474 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.393440    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 11:35:30.393474 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.393441    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tksg2\""
Jul 07 11:35:30.394469 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.394447    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:35:30.405425 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.405397    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"]
Jul 07 11:35:30.470705 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.470658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmk86\" (UniqueName: \"kubernetes.io/projected/d88d8a9d-c171-4e96-8d85-c50d73195ca4-kube-api-access-gmk86\") pod \"cert-manager-operator-controller-manager-55c444bf86-s5f8r\" (UID: \"d88d8a9d-c171-4e96-8d85-c50d73195ca4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.470705 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.470703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d88d8a9d-c171-4e96-8d85-c50d73195ca4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s5f8r\" (UID: \"d88d8a9d-c171-4e96-8d85-c50d73195ca4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.571689 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.571651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmk86\" (UniqueName: \"kubernetes.io/projected/d88d8a9d-c171-4e96-8d85-c50d73195ca4-kube-api-access-gmk86\") pod \"cert-manager-operator-controller-manager-55c444bf86-s5f8r\" (UID: \"d88d8a9d-c171-4e96-8d85-c50d73195ca4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.571689 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.571694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d88d8a9d-c171-4e96-8d85-c50d73195ca4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s5f8r\" (UID: \"d88d8a9d-c171-4e96-8d85-c50d73195ca4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.572004 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.571990    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d88d8a9d-c171-4e96-8d85-c50d73195ca4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s5f8r\" (UID: \"d88d8a9d-c171-4e96-8d85-c50d73195ca4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.581090 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.581061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmk86\" (UniqueName: \"kubernetes.io/projected/d88d8a9d-c171-4e96-8d85-c50d73195ca4-kube-api-access-gmk86\") pod \"cert-manager-operator-controller-manager-55c444bf86-s5f8r\" (UID: \"d88d8a9d-c171-4e96-8d85-c50d73195ca4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.699162 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.699129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"
Jul 07 11:35:30.842757 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:30.842730    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r"]
Jul 07 11:35:30.845383 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:35:30.845354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88d8a9d_c171_4e96_8d85_c50d73195ca4.slice/crio-356869dbe1d55e9135221f2e4cb98559d017af88c6e489282eb865dbbef67248 WatchSource:0}: Error finding container 356869dbe1d55e9135221f2e4cb98559d017af88c6e489282eb865dbbef67248: Status 404 returned error can't find the container with id 356869dbe1d55e9135221f2e4cb98559d017af88c6e489282eb865dbbef67248
Jul 07 11:35:31.435670 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:31.435615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r" event={"ID":"d88d8a9d-c171-4e96-8d85-c50d73195ca4","Type":"ContainerStarted","Data":"356869dbe1d55e9135221f2e4cb98559d017af88c6e489282eb865dbbef67248"}
Jul 07 11:35:32.048210 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:32.048148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:32.147574 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:32.147496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:34.185376 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:34.185339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:34.284039 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:34.284002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:34.451878 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:34.451780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r" event={"ID":"d88d8a9d-c171-4e96-8d85-c50d73195ca4","Type":"ContainerStarted","Data":"48f1c12d41c01bd9cf0bd094f57718c4d0599b53c05970564775cb8af8692bd6"}
Jul 07 11:35:34.476814 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:34.476748    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s5f8r" podStartSLOduration=1.8514261969999999 podStartE2EDuration="4.476726949s" totalImagesPullingTime="2.625300752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:35:34.473933031 +0000 UTC m=+517.513157732" watchObservedRunningTime="2026-07-07 11:35:34.476726949 +0000 UTC m=+517.515951650"
Jul 07 11:35:34.794954 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:34.794847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:34.898966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:34.898914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:36.581708 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:36.581669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:36.999109 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:36.999077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:39.030400 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:39.030360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:39.130952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:39.130908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:42.357886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.357852    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"]
Jul 07 11:35:42.361269 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.361252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.363878 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.363854    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 11:35:42.364049 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.363996    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vjzkg\""
Jul 07 11:35:42.365205 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.365192    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 11:35:42.369111 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.369076    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"]
Jul 07 11:35:42.470140 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.470097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4lb2\" (UniqueName: \"kubernetes.io/projected/a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47-kube-api-access-g4lb2\") pod \"cert-manager-cainjector-559cdd8c87-sfxjb\" (UID: \"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.470319 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.470153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sfxjb\" (UID: \"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.570616 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.570570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4lb2\" (UniqueName: \"kubernetes.io/projected/a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47-kube-api-access-g4lb2\") pod \"cert-manager-cainjector-559cdd8c87-sfxjb\" (UID: \"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.570824 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.570652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sfxjb\" (UID: \"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.579384 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.579346    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sfxjb\" (UID: \"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.579529 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.579512    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4lb2\" (UniqueName: \"kubernetes.io/projected/a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47-kube-api-access-g4lb2\") pod \"cert-manager-cainjector-559cdd8c87-sfxjb\" (UID: \"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.684078 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.684044    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"
Jul 07 11:35:42.828169 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:42.828031    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb"]
Jul 07 11:35:42.831115 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:35:42.831083    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4d76d85_62bc_4fa8_a4d3_1a4f97e37b47.slice/crio-504ad3536ef94e662824501900c7be3124a180e5bd015132f8efe9c9448fad8b WatchSource:0}: Error finding container 504ad3536ef94e662824501900c7be3124a180e5bd015132f8efe9c9448fad8b: Status 404 returned error can't find the container with id 504ad3536ef94e662824501900c7be3124a180e5bd015132f8efe9c9448fad8b
Jul 07 11:35:43.490812 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:43.490730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb" event={"ID":"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47","Type":"ContainerStarted","Data":"504ad3536ef94e662824501900c7be3124a180e5bd015132f8efe9c9448fad8b"}
Jul 07 11:35:44.787288 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:44.787250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:46.286713 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:46.286676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:46.389375 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:46.389344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:46.506988 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:46.506943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb" event={"ID":"a4d76d85-62bc-4fa8-a4d3-1a4f97e37b47","Type":"ContainerStarted","Data":"ca4579e4e40f352ea2c0e554b071371a53d976b279c186536a92a72840e76686"}
Jul 07 11:35:46.523892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:46.523831    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sfxjb" podStartSLOduration=1.851944136 podStartE2EDuration="4.523813164s" totalImagesPullingTime="2.671869028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:35:46.522308447 +0000 UTC m=+529.561533149" watchObservedRunningTime="2026-07-07 11:35:46.523813164 +0000 UTC m=+529.563037864"
Jul 07 11:35:46.743320 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:46.743284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:46.843472 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:46.843437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:48.732663 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.732566    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"]
Jul 07 11:35:48.736020 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.736002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:48.738752 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.738727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 11:35:48.739912 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.739889    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:35:48.740038 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.739892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4tdwq\""
Jul 07 11:35:48.744524 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.744499    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"]
Jul 07 11:35:48.826508 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.826471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt5d6\" (UniqueName: \"kubernetes.io/projected/58f97344-66ac-48d3-808c-ee5b05d34a32-kube-api-access-lt5d6\") pod \"openshift-lws-operator-fd8ccff4c-zg8v7\" (UID: \"58f97344-66ac-48d3-808c-ee5b05d34a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:48.826695 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.826541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58f97344-66ac-48d3-808c-ee5b05d34a32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zg8v7\" (UID: \"58f97344-66ac-48d3-808c-ee5b05d34a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:48.928061 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.928025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt5d6\" (UniqueName: \"kubernetes.io/projected/58f97344-66ac-48d3-808c-ee5b05d34a32-kube-api-access-lt5d6\") pod \"openshift-lws-operator-fd8ccff4c-zg8v7\" (UID: \"58f97344-66ac-48d3-808c-ee5b05d34a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:48.928226 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.928079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58f97344-66ac-48d3-808c-ee5b05d34a32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zg8v7\" (UID: \"58f97344-66ac-48d3-808c-ee5b05d34a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:48.928448 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.928429    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58f97344-66ac-48d3-808c-ee5b05d34a32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zg8v7\" (UID: \"58f97344-66ac-48d3-808c-ee5b05d34a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:48.939010 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:48.938973    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt5d6\" (UniqueName: \"kubernetes.io/projected/58f97344-66ac-48d3-808c-ee5b05d34a32-kube-api-access-lt5d6\") pod \"openshift-lws-operator-fd8ccff4c-zg8v7\" (UID: \"58f97344-66ac-48d3-808c-ee5b05d34a32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:49.046072 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:49.045973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"
Jul 07 11:35:49.183828 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:49.183796    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7"]
Jul 07 11:35:49.186237 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:35:49.186209    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58f97344_66ac_48d3_808c_ee5b05d34a32.slice/crio-4950c6e8960f39c3032f14dce18630eb81277909369f298d8908856a3fb92a7b WatchSource:0}: Error finding container 4950c6e8960f39c3032f14dce18630eb81277909369f298d8908856a3fb92a7b: Status 404 returned error can't find the container with id 4950c6e8960f39c3032f14dce18630eb81277909369f298d8908856a3fb92a7b
Jul 07 11:35:49.521884 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:49.521845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7" event={"ID":"58f97344-66ac-48d3-808c-ee5b05d34a32","Type":"ContainerStarted","Data":"4950c6e8960f39c3032f14dce18630eb81277909369f298d8908856a3fb92a7b"}
Jul 07 11:35:52.537582 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:52.537543    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7" event={"ID":"58f97344-66ac-48d3-808c-ee5b05d34a32","Type":"ContainerStarted","Data":"f0459f8a7cd9089ccde74c0cadd1b77e9165e2a3fc8e3dcd148baf9b6e60bd37"}
Jul 07 11:35:52.554079 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:52.554028    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zg8v7" podStartSLOduration=2.03585621 podStartE2EDuration="4.554010277s" totalImagesPullingTime="2.518154067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:35:52.553236915 +0000 UTC m=+535.592461620" watchObservedRunningTime="2026-07-07 11:35:52.554010277 +0000 UTC m=+535.593234979"
Jul 07 11:35:53.192842 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:53.192805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:53.252149 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:53.252109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:35:55.105698 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:35:55.105661    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:11.067097 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:11.067056    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:11.165505 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:11.165467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:11.729856 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:11.729814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:12.033293 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.033191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:12.143932 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.143887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:12.160193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.160155    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"]
Jul 07 11:36:12.166902 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.166872    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.171551 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.171516    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 11:36:12.171727 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.171697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 11:36:12.171985 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.171960    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 11:36:12.172098 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.172017    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 11:36:12.172098 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.172066    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-29df8\""
Jul 07 11:36:12.192586 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.192551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"]
Jul 07 11:36:12.227003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.226967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/245ae191-49eb-42ae-af53-03c4d7899214-webhook-cert\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.227003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.227005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/245ae191-49eb-42ae-af53-03c4d7899214-manifests\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.227205 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.227036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/245ae191-49eb-42ae-af53-03c4d7899214-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.227205 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.227098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv8xb\" (UniqueName: \"kubernetes.io/projected/245ae191-49eb-42ae-af53-03c4d7899214-kube-api-access-xv8xb\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.227205 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.227147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245ae191-49eb-42ae-af53-03c4d7899214-tmp\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.309195 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.309109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:12.328221 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.328171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245ae191-49eb-42ae-af53-03c4d7899214-tmp\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.328391 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.328238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/245ae191-49eb-42ae-af53-03c4d7899214-webhook-cert\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.328391 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.328269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/245ae191-49eb-42ae-af53-03c4d7899214-manifests\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.328391 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.328310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/245ae191-49eb-42ae-af53-03c4d7899214-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.328535 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.328518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv8xb\" (UniqueName: \"kubernetes.io/projected/245ae191-49eb-42ae-af53-03c4d7899214-kube-api-access-xv8xb\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.328797 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.328771    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/245ae191-49eb-42ae-af53-03c4d7899214-manifests\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.330771 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.330743    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245ae191-49eb-42ae-af53-03c4d7899214-tmp\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.330935 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.330906    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/245ae191-49eb-42ae-af53-03c4d7899214-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.331036 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.331019    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/245ae191-49eb-42ae-af53-03c4d7899214-webhook-cert\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.338210 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.338179    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv8xb\" (UniqueName: \"kubernetes.io/projected/245ae191-49eb-42ae-af53-03c4d7899214-kube-api-access-xv8xb\") pod \"opendatahub-operator-controller-manager-f68d9489b-tk7rh\" (UID: \"245ae191-49eb-42ae-af53-03c4d7899214\") " pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.407880 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.407841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:12.477461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.477425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:12.511977 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.511939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:12.611230 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.611200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:12.628441 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.628395    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"]
Jul 07 11:36:12.632362 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:36:12.632328    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245ae191_49eb_42ae_af53_03c4d7899214.slice/crio-df362c2edd4241780d5ecfc93157a2e31fd97d5d5e256ceb53a2a382eddd02a2 WatchSource:0}: Error finding container df362c2edd4241780d5ecfc93157a2e31fd97d5d5e256ceb53a2a382eddd02a2: Status 404 returned error can't find the container with id df362c2edd4241780d5ecfc93157a2e31fd97d5d5e256ceb53a2a382eddd02a2
Jul 07 11:36:12.711304 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:12.711257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:13.636804 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:13.636764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh" event={"ID":"245ae191-49eb-42ae-af53-03c4d7899214","Type":"ContainerStarted","Data":"df362c2edd4241780d5ecfc93157a2e31fd97d5d5e256ceb53a2a382eddd02a2"}
Jul 07 11:36:16.652975 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:16.652939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh" event={"ID":"245ae191-49eb-42ae-af53-03c4d7899214","Type":"ContainerStarted","Data":"e72113af2c59df382456e6fcffc9e5e20b0b1afb8d8fc3b6864b577d6d76bbb3"}
Jul 07 11:36:17.659534 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:17.659489    2564 generic.go:356] "Generic (PLEG): container finished" podID="245ae191-49eb-42ae-af53-03c4d7899214" containerID="e72113af2c59df382456e6fcffc9e5e20b0b1afb8d8fc3b6864b577d6d76bbb3" exitCode=0
Jul 07 11:36:17.659534 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:17.659535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh" event={"ID":"245ae191-49eb-42ae-af53-03c4d7899214","Type":"ContainerDied","Data":"e72113af2c59df382456e6fcffc9e5e20b0b1afb8d8fc3b6864b577d6d76bbb3"}
Jul 07 11:36:18.666285 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:18.666252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh" event={"ID":"245ae191-49eb-42ae-af53-03c4d7899214","Type":"ContainerStarted","Data":"73614c4a089f2bfcab3a8318a095e049713b5da7de6f9132ed80bae0502b992a"}
Jul 07 11:36:18.666696 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:18.666384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:18.690842 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:18.690789    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh" podStartSLOduration=2.365252386 podStartE2EDuration="6.690775009s" totalImagesPullingTime="3.322016204s" totalInitContainerRuntime="1.003506419s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:18.689319807 +0000 UTC m=+561.728544507" watchObservedRunningTime="2026-07-07 11:36:18.690775009 +0000 UTC m=+561.729999768"
Jul 07 11:36:19.376025 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:19.375985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:19.476424 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:19.476368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:23.869212 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:23.869175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:23.969811 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:23.969776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:29.672769 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:29.672738    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f68d9489b-tk7rh"
Jul 07 11:36:31.420900 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:31.420859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:31.551537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:31.551501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:31.992470 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:31.992429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:32.034895 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.034857    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"]
Jul 07 11:36:32.042152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.042127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.051357 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.051332    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-29r7s\""
Jul 07 11:36:32.052301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.052286    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 11:36:32.052301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.052296    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 11:36:32.052520 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.052507    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 11:36:32.055594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.055578    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 11:36:32.059897 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.059873    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"]
Jul 07 11:36:32.097224 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.097191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvz4w\" (UniqueName: \"kubernetes.io/projected/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-kube-api-access-qvz4w\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.097405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.097232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tls-certs\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.097405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.097262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tmp\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.197886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.197852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvz4w\" (UniqueName: \"kubernetes.io/projected/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-kube-api-access-qvz4w\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.198080 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.197898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tls-certs\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.198080 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.197919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tmp\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.198080 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:32.198035    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 11:36:32.198242 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:32.198105    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tls-certs podName:50e67c32-06a6-4230-8bac-4bb6b79b0eb1 nodeName:}" failed. No retries permitted until 2026-07-07 11:36:32.698085713 +0000 UTC m=+575.737310392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tls-certs") pod "kube-auth-proxy-5474cb5f94-qx7pl" (UID: "50e67c32-06a6-4230-8bac-4bb6b79b0eb1") : secret "kube-auth-proxy-tls" not found
Jul 07 11:36:32.200358 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.200330    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tmp\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.209411 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.209386    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvz4w\" (UniqueName: \"kubernetes.io/projected/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-kube-api-access-qvz4w\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.269988 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.269904    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cgsn5"]
Jul 07 11:36:32.273592 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.273563    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:32.276193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.276162    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 11:36:32.276327 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.276301    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hhqg9\""
Jul 07 11:36:32.281804 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.281769    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cgsn5"]
Jul 07 11:36:32.342142 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.342098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:32.399710 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.399667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b75jg\" (UniqueName: \"kubernetes.io/projected/01823f9a-5c90-4478-848a-b208719e3737-kube-api-access-b75jg\") pod \"odh-model-controller-7998c67dc4-cgsn5\" (UID: \"01823f9a-5c90-4478-848a-b208719e3737\") " pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:32.399885 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.399747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01823f9a-5c90-4478-848a-b208719e3737-cert\") pod \"odh-model-controller-7998c67dc4-cgsn5\" (UID: \"01823f9a-5c90-4478-848a-b208719e3737\") " pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:32.440385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.440346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:32.501136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.501104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b75jg\" (UniqueName: \"kubernetes.io/projected/01823f9a-5c90-4478-848a-b208719e3737-kube-api-access-b75jg\") pod \"odh-model-controller-7998c67dc4-cgsn5\" (UID: \"01823f9a-5c90-4478-848a-b208719e3737\") " pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:32.501324 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.501155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01823f9a-5c90-4478-848a-b208719e3737-cert\") pod \"odh-model-controller-7998c67dc4-cgsn5\" (UID: \"01823f9a-5c90-4478-848a-b208719e3737\") " pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:32.501324 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:32.501292    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 11:36:32.501431 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:32.501373    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01823f9a-5c90-4478-848a-b208719e3737-cert podName:01823f9a-5c90-4478-848a-b208719e3737 nodeName:}" failed. No retries permitted until 2026-07-07 11:36:33.001357004 +0000 UTC m=+576.040581683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01823f9a-5c90-4478-848a-b208719e3737-cert") pod "odh-model-controller-7998c67dc4-cgsn5" (UID: "01823f9a-5c90-4478-848a-b208719e3737") : secret "odh-model-controller-webhook-cert" not found
Jul 07 11:36:32.511241 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.511207    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b75jg\" (UniqueName: \"kubernetes.io/projected/01823f9a-5c90-4478-848a-b208719e3737-kube-api-access-b75jg\") pod \"odh-model-controller-7998c67dc4-cgsn5\" (UID: \"01823f9a-5c90-4478-848a-b208719e3737\") " pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:32.541377 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.541281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:32.641535 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.641497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:32.702588 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.702547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tls-certs\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.705248 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.705218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e67c32-06a6-4230-8bac-4bb6b79b0eb1-tls-certs\") pod \"kube-auth-proxy-5474cb5f94-qx7pl\" (UID: \"50e67c32-06a6-4230-8bac-4bb6b79b0eb1\") " pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:32.916217 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.916101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:32.951724 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:32.951693    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"
Jul 07 11:36:33.005506 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.005468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01823f9a-5c90-4478-848a-b208719e3737-cert\") pod \"odh-model-controller-7998c67dc4-cgsn5\" (UID: \"01823f9a-5c90-4478-848a-b208719e3737\") " pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:33.009012 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.008981    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01823f9a-5c90-4478-848a-b208719e3737-cert\") pod \"odh-model-controller-7998c67dc4-cgsn5\" (UID: \"01823f9a-5c90-4478-848a-b208719e3737\") " pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:33.107797 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.107755    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl"]
Jul 07 11:36:33.110495 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:36:33.110467    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e67c32_06a6_4230_8bac_4bb6b79b0eb1.slice/crio-57c77bad2df6b449932faf31f5d3803b8e6f6edaa8c60ac3e0f2cc3d2b465f81 WatchSource:0}: Error finding container 57c77bad2df6b449932faf31f5d3803b8e6f6edaa8c60ac3e0f2cc3d2b465f81: Status 404 returned error can't find the container with id 57c77bad2df6b449932faf31f5d3803b8e6f6edaa8c60ac3e0f2cc3d2b465f81
Jul 07 11:36:33.185080 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.185038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:33.187559 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.187527    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:33.333812 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.333786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-cgsn5"]
Jul 07 11:36:33.335522 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:36:33.335492    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01823f9a_5c90_4478_848a_b208719e3737.slice/crio-e63a7be6c8e3ad10857fd52c7d7f048bcd7e16891eafa11dcea469880ab027da WatchSource:0}: Error finding container e63a7be6c8e3ad10857fd52c7d7f048bcd7e16891eafa11dcea469880ab027da: Status 404 returned error can't find the container with id e63a7be6c8e3ad10857fd52c7d7f048bcd7e16891eafa11dcea469880ab027da
Jul 07 11:36:33.647723 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.647613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:33.652842 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.652813    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"]
Jul 07 11:36:33.657363 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.657345    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.660433 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.660409    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 11:36:33.660567 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.660551    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 11:36:33.660654 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.660623    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7sw6n\""
Jul 07 11:36:33.660836 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.660822    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 11:36:33.660962 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.660947    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 11:36:33.677829 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.677800    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"]
Jul 07 11:36:33.736872 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.736841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:33.747445 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.747404    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl" event={"ID":"50e67c32-06a6-4230-8bac-4bb6b79b0eb1","Type":"ContainerStarted","Data":"57c77bad2df6b449932faf31f5d3803b8e6f6edaa8c60ac3e0f2cc3d2b465f81"}
Jul 07 11:36:33.748641 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.748601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5" event={"ID":"01823f9a-5c90-4478-848a-b208719e3737","Type":"ContainerStarted","Data":"e63a7be6c8e3ad10857fd52c7d7f048bcd7e16891eafa11dcea469880ab027da"}
Jul 07 11:36:33.812458 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.812427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.812651 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.812481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-cacerts\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.812651 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.812539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.812747 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.812707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33bf161a-08af-4ba4-9822-702a7314f5a2-local-certs\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.812796 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.812761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2xp\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-kube-api-access-px2xp\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.812841 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.812815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.812875 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.812859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-token\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.914406 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.914327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33bf161a-08af-4ba4-9822-702a7314f5a2-local-certs\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.914406 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.914382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2xp\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-kube-api-access-px2xp\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.914598 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.914415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.914598 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.914449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-token\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.914598 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.914487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.914598 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.914522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-cacerts\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.914598 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.914550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.915446 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.915415    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.918531 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.918499    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33bf161a-08af-4ba4-9822-702a7314f5a2-local-certs\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.918694 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.918573    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.918752 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.918711    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.918797 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.918779    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-cacerts\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.923739 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.923711    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-token\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.924097 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.924072    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2xp\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-kube-api-access-px2xp\") pod \"istiod-openshift-gateway-7574459656-b2sgx\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.967346 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.967310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:33.974455 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:33.974423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:34.138367 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:34.138161    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"]
Jul 07 11:36:34.140911 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:36:34.140869    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bf161a_08af_4ba4_9822_702a7314f5a2.slice/crio-4ce4402a7c3e9df52d509ab22f5e9c103c2ad5a78410a8e43c5af4feb95cba97 WatchSource:0}: Error finding container 4ce4402a7c3e9df52d509ab22f5e9c103c2ad5a78410a8e43c5af4feb95cba97: Status 404 returned error can't find the container with id 4ce4402a7c3e9df52d509ab22f5e9c103c2ad5a78410a8e43c5af4feb95cba97
Jul 07 11:36:34.758237 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:34.758167    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx" event={"ID":"33bf161a-08af-4ba4-9822-702a7314f5a2","Type":"ContainerStarted","Data":"4ce4402a7c3e9df52d509ab22f5e9c103c2ad5a78410a8e43c5af4feb95cba97"}
Jul 07 11:36:34.830939 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:34.830890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:38.167151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.165343    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 11:36:38.167151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.165483    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 11:36:38.784124 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.784082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl" event={"ID":"50e67c32-06a6-4230-8bac-4bb6b79b0eb1","Type":"ContainerStarted","Data":"bdce7b8ff6ac0ac9a127cd45e4e6e9dd696be13fcc9bdf81ffbe93bf2bd32c12"}
Jul 07 11:36:38.786003 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.785972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5" event={"ID":"01823f9a-5c90-4478-848a-b208719e3737","Type":"ContainerStarted","Data":"a93028ec262fceed0438f30b1a65fd51527c5ef339f2c2cf0e43ede47787038c"}
Jul 07 11:36:38.786135 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.786041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:38.788041 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.788013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx" event={"ID":"33bf161a-08af-4ba4-9822-702a7314f5a2","Type":"ContainerStarted","Data":"cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd"}
Jul 07 11:36:38.788185 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.788154    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:38.814809 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.814755    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5474cb5f94-qx7pl" podStartSLOduration=1.7589618009999999 podStartE2EDuration="6.814739059s" totalImagesPullingTime="5.055777258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:38.813310386 +0000 UTC m=+581.852535086" watchObservedRunningTime="2026-07-07 11:36:38.814739059 +0000 UTC m=+581.853963760"
Jul 07 11:36:38.842891 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.842841    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5" podStartSLOduration=2.02237307 podStartE2EDuration="6.84282419s" totalImagesPullingTime="4.82045112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:38.841298113 +0000 UTC m=+581.880522819" watchObservedRunningTime="2026-07-07 11:36:38.84282419 +0000 UTC m=+581.882048908"
Jul 07 11:36:38.882834 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.882781    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx" podStartSLOduration=1.861937993 podStartE2EDuration="5.882762272s" totalImagesPullingTime="4.020824279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:38.880830223 +0000 UTC m=+581.920054982" watchObservedRunningTime="2026-07-07 11:36:38.882762272 +0000 UTC m=+581.921986972"
Jul 07 11:36:38.967873 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:38.967833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:39.795585 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:39.795547    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:40.654014 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:40.653981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:40.794622 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:40.794576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:42.965524 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:42.965482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:43.008504 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.008465    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"]
Jul 07 11:36:43.012124 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.012100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.016121 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.016097    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 11:36:43.019828 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.019806    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xhfcd\""
Jul 07 11:36:43.041567 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.041528    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"]
Jul 07 11:36:43.047727 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.047699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"]
Jul 07 11:36:43.047890 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.047791    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.052163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.052132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ztngw\""
Jul 07 11:36:43.052163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.052145    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 11:36:43.063371 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.063341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"]
Jul 07 11:36:43.095844 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.095797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:43.107903 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.107876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b269b83-9145-4503-bc2a-fb988d962e0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-b4qrv\" (UID: \"2b269b83-9145-4503-bc2a-fb988d962e0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.108018 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.107915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6b68\" (UniqueName: \"kubernetes.io/projected/2b269b83-9145-4503-bc2a-fb988d962e0b-kube-api-access-s6b68\") pod \"kserve-controller-manager-d6f4b65b8-b4qrv\" (UID: \"2b269b83-9145-4503-bc2a-fb988d962e0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.209249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.209211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9tqj\" (UniqueName: \"kubernetes.io/projected/0ad07db8-4076-4917-89d9-7ab944bbfe81-kube-api-access-z9tqj\") pod \"llmisvc-controller-manager-777c6bd7d5-5cdjr\" (UID: \"0ad07db8-4076-4917-89d9-7ab944bbfe81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.209461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.209263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b269b83-9145-4503-bc2a-fb988d962e0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-b4qrv\" (UID: \"2b269b83-9145-4503-bc2a-fb988d962e0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.209461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.209300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6b68\" (UniqueName: \"kubernetes.io/projected/2b269b83-9145-4503-bc2a-fb988d962e0b-kube-api-access-s6b68\") pod \"kserve-controller-manager-d6f4b65b8-b4qrv\" (UID: \"2b269b83-9145-4503-bc2a-fb988d962e0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.209461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.209345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ad07db8-4076-4917-89d9-7ab944bbfe81-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5cdjr\" (UID: \"0ad07db8-4076-4917-89d9-7ab944bbfe81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.209461 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:43.209401    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 07 11:36:43.209697 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:43.209478    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b269b83-9145-4503-bc2a-fb988d962e0b-cert podName:2b269b83-9145-4503-bc2a-fb988d962e0b nodeName:}" failed. No retries permitted until 2026-07-07 11:36:43.709457199 +0000 UTC m=+586.748681878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b269b83-9145-4503-bc2a-fb988d962e0b-cert") pod "kserve-controller-manager-d6f4b65b8-b4qrv" (UID: "2b269b83-9145-4503-bc2a-fb988d962e0b") : secret "kserve-webhook-server-cert" not found
Jul 07 11:36:43.229574 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.229486    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6b68\" (UniqueName: \"kubernetes.io/projected/2b269b83-9145-4503-bc2a-fb988d962e0b-kube-api-access-s6b68\") pod \"kserve-controller-manager-d6f4b65b8-b4qrv\" (UID: \"2b269b83-9145-4503-bc2a-fb988d962e0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.310012 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.309976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9tqj\" (UniqueName: \"kubernetes.io/projected/0ad07db8-4076-4917-89d9-7ab944bbfe81-kube-api-access-z9tqj\") pod \"llmisvc-controller-manager-777c6bd7d5-5cdjr\" (UID: \"0ad07db8-4076-4917-89d9-7ab944bbfe81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.310164 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.310061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ad07db8-4076-4917-89d9-7ab944bbfe81-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5cdjr\" (UID: \"0ad07db8-4076-4917-89d9-7ab944bbfe81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.310256 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:43.310167    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 11:36:43.310256 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:43.310231    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad07db8-4076-4917-89d9-7ab944bbfe81-cert podName:0ad07db8-4076-4917-89d9-7ab944bbfe81 nodeName:}" failed. No retries permitted until 2026-07-07 11:36:43.81021322 +0000 UTC m=+586.849437899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0ad07db8-4076-4917-89d9-7ab944bbfe81-cert") pod "llmisvc-controller-manager-777c6bd7d5-5cdjr" (UID: "0ad07db8-4076-4917-89d9-7ab944bbfe81") : secret "llmisvc-webhook-server-cert" not found
Jul 07 11:36:43.338405 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.338370    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9tqj\" (UniqueName: \"kubernetes.io/projected/0ad07db8-4076-4917-89d9-7ab944bbfe81-kube-api-access-z9tqj\") pod \"llmisvc-controller-manager-777c6bd7d5-5cdjr\" (UID: \"0ad07db8-4076-4917-89d9-7ab944bbfe81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.341853 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.341824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:43.434815 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.434782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:43.580952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.580864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:36:43.713510 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.713472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b269b83-9145-4503-bc2a-fb988d962e0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-b4qrv\" (UID: \"2b269b83-9145-4503-bc2a-fb988d962e0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.716152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.716118    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b269b83-9145-4503-bc2a-fb988d962e0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-b4qrv\" (UID: \"2b269b83-9145-4503-bc2a-fb988d962e0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.816201 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.814340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ad07db8-4076-4917-89d9-7ab944bbfe81-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5cdjr\" (UID: \"0ad07db8-4076-4917-89d9-7ab944bbfe81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.817301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.817274    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ad07db8-4076-4917-89d9-7ab944bbfe81-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5cdjr\" (UID: \"0ad07db8-4076-4917-89d9-7ab944bbfe81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:43.925564 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.925532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:43.949998 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.949968    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"]
Jul 07 11:36:43.950167 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.950147    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx" podUID="33bf161a-08af-4ba4-9822-702a7314f5a2" containerName="discovery" containerID="cri-o://cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd" gracePeriod=30
Jul 07 11:36:43.958265 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:43.958234    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:44.077597 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.077554    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"]
Jul 07 11:36:44.079082 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:36:44.079040    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b269b83_9145_4503_bc2a_fb988d962e0b.slice/crio-bd778413ce00b5186bcf9c172f581a346e841ac6daae8a858cb03aadd4167195 WatchSource:0}: Error finding container bd778413ce00b5186bcf9c172f581a346e841ac6daae8a858cb03aadd4167195: Status 404 returned error can't find the container with id bd778413ce00b5186bcf9c172f581a346e841ac6daae8a858cb03aadd4167195
Jul 07 11:36:44.116970 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.116945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"]
Jul 07 11:36:44.119549 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:36:44.119515    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ad07db8_4076_4917_89d9_7ab944bbfe81.slice/crio-e929b14eeeeb43de1770a5aad9df8f24c15a081058beb30d28a351768805a22b WatchSource:0}: Error finding container e929b14eeeeb43de1770a5aad9df8f24c15a081058beb30d28a351768805a22b: Status 404 returned error can't find the container with id e929b14eeeeb43de1770a5aad9df8f24c15a081058beb30d28a351768805a22b
Jul 07 11:36:44.207842 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.207816    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:44.318253 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.318224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-dns-cert\") pod \"33bf161a-08af-4ba4-9822-702a7314f5a2\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") "
Jul 07 11:36:44.318402 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.318271    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-token\") pod \"33bf161a-08af-4ba4-9822-702a7314f5a2\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") "
Jul 07 11:36:44.318402 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.318337    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33bf161a-08af-4ba4-9822-702a7314f5a2-local-certs\") pod \"33bf161a-08af-4ba4-9822-702a7314f5a2\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") "
Jul 07 11:36:44.318402 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.318385    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-cacerts\") pod \"33bf161a-08af-4ba4-9822-702a7314f5a2\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") "
Jul 07 11:36:44.318541 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.318423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-kubeconfig\") pod \"33bf161a-08af-4ba4-9822-702a7314f5a2\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") "
Jul 07 11:36:44.318541 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.318445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px2xp\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-kube-api-access-px2xp\") pod \"33bf161a-08af-4ba4-9822-702a7314f5a2\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") "
Jul 07 11:36:44.318541 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.318488    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-ca-configmap\") pod \"33bf161a-08af-4ba4-9822-702a7314f5a2\" (UID: \"33bf161a-08af-4ba4-9822-702a7314f5a2\") "
Jul 07 11:36:44.320801 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.320725    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "33bf161a-08af-4ba4-9822-702a7314f5a2" (UID: "33bf161a-08af-4ba4-9822-702a7314f5a2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:36:44.320956 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.320871    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "33bf161a-08af-4ba4-9822-702a7314f5a2" (UID: "33bf161a-08af-4ba4-9822-702a7314f5a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:36:44.322528 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.322504    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-cacerts" (OuterVolumeSpecName: "cacerts") pod "33bf161a-08af-4ba4-9822-702a7314f5a2" (UID: "33bf161a-08af-4ba4-9822-702a7314f5a2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:36:44.322640 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.322556    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33bf161a-08af-4ba4-9822-702a7314f5a2-local-certs" (OuterVolumeSpecName: "local-certs") pod "33bf161a-08af-4ba4-9822-702a7314f5a2" (UID: "33bf161a-08af-4ba4-9822-702a7314f5a2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:36:44.322640 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.322577    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "33bf161a-08af-4ba4-9822-702a7314f5a2" (UID: "33bf161a-08af-4ba4-9822-702a7314f5a2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:36:44.323916 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.323892    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "33bf161a-08af-4ba4-9822-702a7314f5a2" (UID: "33bf161a-08af-4ba4-9822-702a7314f5a2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:36:44.325359 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.325337    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-kube-api-access-px2xp" (OuterVolumeSpecName: "kube-api-access-px2xp") pod "33bf161a-08af-4ba4-9822-702a7314f5a2" (UID: "33bf161a-08af-4ba4-9822-702a7314f5a2"). InnerVolumeSpecName "kube-api-access-px2xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:36:44.419962 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.419925    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-dns-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:36:44.419962 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.419958    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:36:44.419962 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.419968    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33bf161a-08af-4ba4-9822-702a7314f5a2-local-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:36:44.420193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.419976    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-cacerts\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:36:44.420193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.419984    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-kubeconfig\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:36:44.420193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.419993    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px2xp\" (UniqueName: \"kubernetes.io/projected/33bf161a-08af-4ba4-9822-702a7314f5a2-kube-api-access-px2xp\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:36:44.420193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.420002    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33bf161a-08af-4ba4-9822-702a7314f5a2-istio-csr-ca-configmap\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:36:44.822345 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.822227    2564 generic.go:356] "Generic (PLEG): container finished" podID="33bf161a-08af-4ba4-9822-702a7314f5a2" containerID="cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd" exitCode=0
Jul 07 11:36:44.822345 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.822285    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"
Jul 07 11:36:44.822345 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.822300    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx" event={"ID":"33bf161a-08af-4ba4-9822-702a7314f5a2","Type":"ContainerDied","Data":"cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd"}
Jul 07 11:36:44.822725 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.822359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx" event={"ID":"33bf161a-08af-4ba4-9822-702a7314f5a2","Type":"ContainerDied","Data":"4ce4402a7c3e9df52d509ab22f5e9c103c2ad5a78410a8e43c5af4feb95cba97"}
Jul 07 11:36:44.822725 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.822387    2564 scope.go:117] "RemoveContainer" containerID="cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd"
Jul 07 11:36:44.823851 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.823825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv" event={"ID":"2b269b83-9145-4503-bc2a-fb988d962e0b","Type":"ContainerStarted","Data":"bd778413ce00b5186bcf9c172f581a346e841ac6daae8a858cb03aadd4167195"}
Jul 07 11:36:44.825590 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.825563    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr" event={"ID":"0ad07db8-4076-4917-89d9-7ab944bbfe81","Type":"ContainerStarted","Data":"e929b14eeeeb43de1770a5aad9df8f24c15a081058beb30d28a351768805a22b"}
Jul 07 11:36:44.834187 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.834164    2564 scope.go:117] "RemoveContainer" containerID="cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd"
Jul 07 11:36:44.834523 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:36:44.834500    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd\": container with ID starting with cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd not found: ID does not exist" containerID="cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd"
Jul 07 11:36:44.834647 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.834533    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd"} err="failed to get container status \"cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd\": rpc error: code = NotFound desc = could not find container \"cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd\": container with ID starting with cf835ebcad7d3f0a580f67e4c6be95fec3f7666f6eb003c504045ffbad9406cd not found: ID does not exist"
Jul 07 11:36:44.854218 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.854179    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"]
Jul 07 11:36:44.865091 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:44.865062    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b2sgx"]
Jul 07 11:36:45.421671 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:45.421348    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33bf161a-08af-4ba4-9822-702a7314f5a2" path="/var/lib/kubelet/pods/33bf161a-08af-4ba4-9822-702a7314f5a2/volumes"
Jul 07 11:36:47.847580 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:47.847526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr" event={"ID":"0ad07db8-4076-4917-89d9-7ab944bbfe81","Type":"ContainerStarted","Data":"85a29413ab07ec5a7a4d07c14d0ff0f4b36f1db82b933206d1ee18295bac5546"}
Jul 07 11:36:47.848063 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:47.847667    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:36:47.849407 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:47.849379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv" event={"ID":"2b269b83-9145-4503-bc2a-fb988d962e0b","Type":"ContainerStarted","Data":"f0f249992592887be51bb53144e7272d21098ae9be99f14e9cb8e51fa9be54e8"}
Jul 07 11:36:47.849553 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:47.849528    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:36:47.873963 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:47.873913    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr" podStartSLOduration=2.681877198 podStartE2EDuration="5.873897043s" totalImagesPullingTime="3.192019845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:47.872983194 +0000 UTC m=+590.912207896" watchObservedRunningTime="2026-07-07 11:36:47.873897043 +0000 UTC m=+590.913121721"
Jul 07 11:36:49.796789 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:49.796758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-cgsn5"
Jul 07 11:36:49.854414 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:49.854359    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv" podStartSLOduration=4.626486685 podStartE2EDuration="7.854340249s" totalImagesPullingTime="3.227853564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:36:47.894973078 +0000 UTC m=+590.934197781" watchObservedRunningTime="2026-07-07 11:36:49.854340249 +0000 UTC m=+592.893564949"
Jul 07 11:36:57.365355 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:57.365326    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:36:57.365948 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:36:57.365327    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:37:07.456683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:07.456622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:07.514615 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:07.514574    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:15.629621 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:15.629583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:15.686461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:15.686410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:17.573867 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:17.573779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:17.626679 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:17.626613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:18.856751 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:18.856723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5cdjr"
Jul 07 11:37:18.859881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:18.859859    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b4qrv"
Jul 07 11:37:32.889298 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:32.889257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:32.991310 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:32.991273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:33.020069 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.020024    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sj4hv"]
Jul 07 11:37:33.020834 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.020809    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33bf161a-08af-4ba4-9822-702a7314f5a2" containerName="discovery"
Jul 07 11:37:33.020834 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.020834    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="33bf161a-08af-4ba4-9822-702a7314f5a2" containerName="discovery"
Jul 07 11:37:33.021077 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.021062    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="33bf161a-08af-4ba4-9822-702a7314f5a2" containerName="discovery"
Jul 07 11:37:33.025102 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.025059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv"
Jul 07 11:37:33.028018 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.027983    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 11:37:33.028226 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.027984    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 11:37:33.028226 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.028062    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-v5zpr\""
Jul 07 11:37:33.032057 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.032032    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sj4hv"]
Jul 07 11:37:33.069291 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.069245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:37:33.155829 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.155739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdxv\" (UniqueName: \"kubernetes.io/projected/5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c-kube-api-access-dxdxv\") pod \"kuadrant-operator-catalog-sj4hv\" (UID: \"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c\") " pod="kuadrant-system/kuadrant-operator-catalog-sj4hv"
Jul 07 11:37:33.256496 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.256459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdxv\" (UniqueName: \"kubernetes.io/projected/5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c-kube-api-access-dxdxv\") pod \"kuadrant-operator-catalog-sj4hv\" (UID: \"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c\") " pod="kuadrant-system/kuadrant-operator-catalog-sj4hv"
Jul 07 11:37:33.265176 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.265137    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdxv\" (UniqueName: \"kubernetes.io/projected/5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c-kube-api-access-dxdxv\") pod \"kuadrant-operator-catalog-sj4hv\" (UID: \"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c\") " pod="kuadrant-system/kuadrant-operator-catalog-sj4hv"
Jul 07 11:37:33.338302 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.338253    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv"
Jul 07 11:37:33.391825 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.391784    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sj4hv"]
Jul 07 11:37:33.480703 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.480678    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sj4hv"]
Jul 07 11:37:33.483585 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:37:33.483551    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f74bf0a_fa16_4b31_874d_5a4d8cd21f9c.slice/crio-f00cb4b15b31b62029ad4131d34a7c0419d70790e0d2543a79c49d82e3e7465f WatchSource:0}: Error finding container f00cb4b15b31b62029ad4131d34a7c0419d70790e0d2543a79c49d82e3e7465f: Status 404 returned error can't find the container with id f00cb4b15b31b62029ad4131d34a7c0419d70790e0d2543a79c49d82e3e7465f
Jul 07 11:37:33.484992 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.484969    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:37:33.598119 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.598085    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g2rsp"]
Jul 07 11:37:33.601058 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.601040    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:33.609582 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.609548    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g2rsp"]
Jul 07 11:37:33.762042 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.761957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8qzb\" (UniqueName: \"kubernetes.io/projected/95ede532-ded5-4aef-93c6-39b74e6ddd9a-kube-api-access-f8qzb\") pod \"kuadrant-operator-catalog-g2rsp\" (UID: \"95ede532-ded5-4aef-93c6-39b74e6ddd9a\") " pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:33.863057 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.863025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8qzb\" (UniqueName: \"kubernetes.io/projected/95ede532-ded5-4aef-93c6-39b74e6ddd9a-kube-api-access-f8qzb\") pod \"kuadrant-operator-catalog-g2rsp\" (UID: \"95ede532-ded5-4aef-93c6-39b74e6ddd9a\") " pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:33.872716 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.872688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8qzb\" (UniqueName: \"kubernetes.io/projected/95ede532-ded5-4aef-93c6-39b74e6ddd9a-kube-api-access-f8qzb\") pod \"kuadrant-operator-catalog-g2rsp\" (UID: \"95ede532-ded5-4aef-93c6-39b74e6ddd9a\") " pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:33.910880 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:33.910800    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:34.061021 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:34.060994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g2rsp"]
Jul 07 11:37:34.072019 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:34.071982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv" event={"ID":"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c","Type":"ContainerStarted","Data":"f00cb4b15b31b62029ad4131d34a7c0419d70790e0d2543a79c49d82e3e7465f"}
Jul 07 11:37:34.123759 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:37:34.123726    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ede532_ded5_4aef_93c6_39b74e6ddd9a.slice/crio-99678cd727872ccc0691f90935b5aa6d0d7353cb1eb8f18154ea7540b63f37e3 WatchSource:0}: Error finding container 99678cd727872ccc0691f90935b5aa6d0d7353cb1eb8f18154ea7540b63f37e3: Status 404 returned error can't find the container with id 99678cd727872ccc0691f90935b5aa6d0d7353cb1eb8f18154ea7540b63f37e3
Jul 07 11:37:35.079921 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:35.079880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp" event={"ID":"95ede532-ded5-4aef-93c6-39b74e6ddd9a","Type":"ContainerStarted","Data":"99678cd727872ccc0691f90935b5aa6d0d7353cb1eb8f18154ea7540b63f37e3"}
Jul 07 11:37:36.086127 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.086088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp" event={"ID":"95ede532-ded5-4aef-93c6-39b74e6ddd9a","Type":"ContainerStarted","Data":"a1e3da915f523271bac42df375583e63f90f32447fdbe81f15801324951cd838"}
Jul 07 11:37:36.087613 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.087587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv" event={"ID":"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c","Type":"ContainerStarted","Data":"e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d"}
Jul 07 11:37:36.087778 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.087738    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv" podUID="5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c" containerName="registry-server" containerID="cri-o://e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d" gracePeriod=2
Jul 07 11:37:36.104684 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.104603    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp" podStartSLOduration=1.705020095 podStartE2EDuration="3.104581106s" totalImagesPullingTime="1.399561011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:37:36.103922627 +0000 UTC m=+639.143147348" watchObservedRunningTime="2026-07-07 11:37:36.104581106 +0000 UTC m=+639.143805808"
Jul 07 11:37:36.356196 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.356169    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv"
Jul 07 11:37:36.489748 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.489708    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxdxv\" (UniqueName: \"kubernetes.io/projected/5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c-kube-api-access-dxdxv\") pod \"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c\" (UID: \"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c\") "
Jul 07 11:37:36.492163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.492126    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c-kube-api-access-dxdxv" (OuterVolumeSpecName: "kube-api-access-dxdxv") pod "5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c" (UID: "5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c"). InnerVolumeSpecName "kube-api-access-dxdxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:37:36.590464 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:36.590364    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxdxv\" (UniqueName: \"kubernetes.io/projected/5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c-kube-api-access-dxdxv\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:37:37.100795 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.100753    2564 generic.go:356] "Generic (PLEG): container finished" podID="5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c" containerID="e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d" exitCode=0
Jul 07 11:37:37.100795 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.100794    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv"
Jul 07 11:37:37.101203 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.100836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv" event={"ID":"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c","Type":"ContainerDied","Data":"e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d"}
Jul 07 11:37:37.101203 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.100911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sj4hv" event={"ID":"5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c","Type":"ContainerDied","Data":"f00cb4b15b31b62029ad4131d34a7c0419d70790e0d2543a79c49d82e3e7465f"}
Jul 07 11:37:37.101203 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.100938    2564 scope.go:117] "RemoveContainer" containerID="e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d"
Jul 07 11:37:37.110679 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.110654    2564 scope.go:117] "RemoveContainer" containerID="e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d"
Jul 07 11:37:37.110989 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:37:37.110970    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d\": container with ID starting with e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d not found: ID does not exist" containerID="e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d"
Jul 07 11:37:37.111036 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.110999    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d"} err="failed to get container status \"e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d\": rpc error: code = NotFound desc = could not find container \"e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d\": container with ID starting with e04cb4ac010ae5ddb3c867002591efe7b94602a33b742e0bd8d36154594d5f0d not found: ID does not exist"
Jul 07 11:37:37.122983 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.122951    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sj4hv"]
Jul 07 11:37:37.127291 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.127265    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sj4hv"]
Jul 07 11:37:37.417668 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:37.417622    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c" path="/var/lib/kubelet/pods/5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c/volumes"
Jul 07 11:37:43.911699 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:43.911660    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:43.912104 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:43.911735    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:43.935723 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:43.935696    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:37:44.157982 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:37:44.157955    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-g2rsp"
Jul 07 11:38:01.203365 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:01.203317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:01.816479 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:01.816438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:02.832435 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:02.832402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:05.300942 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.300905    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"]
Jul 07 11:38:05.301408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.301359    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c" containerName="registry-server"
Jul 07 11:38:05.301408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.301375    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c" containerName="registry-server"
Jul 07 11:38:05.301516 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.301464    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f74bf0a-fa16-4b31-874d-5a4d8cd21f9c" containerName="registry-server"
Jul 07 11:38:05.309014 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.308987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"
Jul 07 11:38:05.311833 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.311813    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-hrpbh\""
Jul 07 11:38:05.322162 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.322133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"]
Jul 07 11:38:05.448245 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.448205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zl8p\" (UniqueName: \"kubernetes.io/projected/7fd799f9-00b7-40f3-9c99-ff3f32bcbca5-kube-api-access-9zl8p\") pod \"authorino-operator-75cc8d5cb7-8gj7b\" (UID: \"7fd799f9-00b7-40f3-9c99-ff3f32bcbca5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"
Jul 07 11:38:05.549348 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.549304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zl8p\" (UniqueName: \"kubernetes.io/projected/7fd799f9-00b7-40f3-9c99-ff3f32bcbca5-kube-api-access-9zl8p\") pod \"authorino-operator-75cc8d5cb7-8gj7b\" (UID: \"7fd799f9-00b7-40f3-9c99-ff3f32bcbca5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"
Jul 07 11:38:05.565749 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.565684    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zl8p\" (UniqueName: \"kubernetes.io/projected/7fd799f9-00b7-40f3-9c99-ff3f32bcbca5-kube-api-access-9zl8p\") pod \"authorino-operator-75cc8d5cb7-8gj7b\" (UID: \"7fd799f9-00b7-40f3-9c99-ff3f32bcbca5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"
Jul 07 11:38:05.620286 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.620239    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"
Jul 07 11:38:05.768149 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:05.768115    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"]
Jul 07 11:38:05.772228 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:05.772200    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd799f9_00b7_40f3_9c99_ff3f32bcbca5.slice/crio-0548dbce5b56de280c0be09818360becc616acfaf88f2b74e26b3b6f01f8b358 WatchSource:0}: Error finding container 0548dbce5b56de280c0be09818360becc616acfaf88f2b74e26b3b6f01f8b358: Status 404 returned error can't find the container with id 0548dbce5b56de280c0be09818360becc616acfaf88f2b74e26b3b6f01f8b358
Jul 07 11:38:06.237565 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:06.237512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:06.241845 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:06.241815    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b" event={"ID":"7fd799f9-00b7-40f3-9c99-ff3f32bcbca5","Type":"ContainerStarted","Data":"0548dbce5b56de280c0be09818360becc616acfaf88f2b74e26b3b6f01f8b358"}
Jul 07 11:38:08.253871 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.253770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b" event={"ID":"7fd799f9-00b7-40f3-9c99-ff3f32bcbca5","Type":"ContainerStarted","Data":"dde11c00a60c4cc78380fc1eb619f3e242faa120da65ef21379c336bec9dd4df"}
Jul 07 11:38:08.254218 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.253924    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"
Jul 07 11:38:08.274782 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.274726    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b" podStartSLOduration=1.090155391 podStartE2EDuration="3.274706964s" totalImagesPullingTime="2.184551573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:08.271775284 +0000 UTC m=+671.310999999" watchObservedRunningTime="2026-07-07 11:38:08.274706964 +0000 UTC m=+671.313931664"
Jul 07 11:38:08.312125 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.312087    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"]
Jul 07 11:38:08.315702 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.315679    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"
Jul 07 11:38:08.326507 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.326482    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4gg2t\""
Jul 07 11:38:08.326766 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.326751    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 11:38:08.335553 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.335525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"]
Jul 07 11:38:08.384534 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.384498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9h6\" (UniqueName: \"kubernetes.io/projected/b115d5b8-e2a1-4fc3-8a66-f62a3d52d047-kube-api-access-5p9h6\") pod \"dns-operator-controller-manager-864dd78c4c-zkp2h\" (UID: \"b115d5b8-e2a1-4fc3-8a66-f62a3d52d047\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"
Jul 07 11:38:08.485994 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.485956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9h6\" (UniqueName: \"kubernetes.io/projected/b115d5b8-e2a1-4fc3-8a66-f62a3d52d047-kube-api-access-5p9h6\") pod \"dns-operator-controller-manager-864dd78c4c-zkp2h\" (UID: \"b115d5b8-e2a1-4fc3-8a66-f62a3d52d047\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"
Jul 07 11:38:08.501327 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.501296    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9h6\" (UniqueName: \"kubernetes.io/projected/b115d5b8-e2a1-4fc3-8a66-f62a3d52d047-kube-api-access-5p9h6\") pod \"dns-operator-controller-manager-864dd78c4c-zkp2h\" (UID: \"b115d5b8-e2a1-4fc3-8a66-f62a3d52d047\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"
Jul 07 11:38:08.625928 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.625837    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"
Jul 07 11:38:08.767562 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:08.767537    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"]
Jul 07 11:38:08.770021 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:08.769993    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb115d5b8_e2a1_4fc3_8a66_f62a3d52d047.slice/crio-fbcf642123f783aa235c2888451630c528d84690abaebbed46d3e3c64fbaa0a0 WatchSource:0}: Error finding container fbcf642123f783aa235c2888451630c528d84690abaebbed46d3e3c64fbaa0a0: Status 404 returned error can't find the container with id fbcf642123f783aa235c2888451630c528d84690abaebbed46d3e3c64fbaa0a0
Jul 07 11:38:09.028286 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:09.028254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:09.260766 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:09.260734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h" event={"ID":"b115d5b8-e2a1-4fc3-8a66-f62a3d52d047","Type":"ContainerStarted","Data":"fbcf642123f783aa235c2888451630c528d84690abaebbed46d3e3c64fbaa0a0"}
Jul 07 11:38:09.460480 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:09.460438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:10.870196 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:10.870154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:11.274410 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:11.274371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h" event={"ID":"b115d5b8-e2a1-4fc3-8a66-f62a3d52d047","Type":"ContainerStarted","Data":"6f83cf2a296cb03916d371bba5d343ca2fafb2f81cb169d7361cd364aecec840"}
Jul 07 11:38:11.274610 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:11.274563    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"
Jul 07 11:38:11.298558 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:11.298505    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h" podStartSLOduration=1.092754182 podStartE2EDuration="3.298490284s" totalImagesPullingTime="2.205736102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:11.296388871 +0000 UTC m=+674.335613571" watchObservedRunningTime="2026-07-07 11:38:11.298490284 +0000 UTC m=+674.337715033"
Jul 07 11:38:12.700987 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.700948    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"]
Jul 07 11:38:12.704604 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.704586    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:12.707239 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.707218    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qcgf6\""
Jul 07 11:38:12.719334 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.719311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"]
Jul 07 11:38:12.826969 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.826925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qgj\" (UniqueName: \"kubernetes.io/projected/6ad558a7-f580-440e-a653-ae99162c574d-kube-api-access-42qgj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:12.827137 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.826998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad558a7-f580-440e-a653-ae99162c574d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:12.927995 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.927957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qgj\" (UniqueName: \"kubernetes.io/projected/6ad558a7-f580-440e-a653-ae99162c574d-kube-api-access-42qgj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:12.928177 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.928028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad558a7-f580-440e-a653-ae99162c574d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:12.928436 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.928419    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad558a7-f580-440e-a653-ae99162c574d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:12.941243 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:12.941216    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qgj\" (UniqueName: \"kubernetes.io/projected/6ad558a7-f580-440e-a653-ae99162c574d-kube-api-access-42qgj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:13.015292 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:13.015198    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:13.159881 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:13.159852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"]
Jul 07 11:38:13.163493 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:13.163457    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad558a7_f580_440e_a653_ae99162c574d.slice/crio-1b55f99769fdcd2313ae7a9db5d9bc197d4aadf481dd35dc683f2d4d85bc05ab WatchSource:0}: Error finding container 1b55f99769fdcd2313ae7a9db5d9bc197d4aadf481dd35dc683f2d4d85bc05ab: Status 404 returned error can't find the container with id 1b55f99769fdcd2313ae7a9db5d9bc197d4aadf481dd35dc683f2d4d85bc05ab
Jul 07 11:38:13.233981 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:13.233951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:13.287250 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:13.287152    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc" event={"ID":"6ad558a7-f580-440e-a653-ae99162c574d","Type":"ContainerStarted","Data":"1b55f99769fdcd2313ae7a9db5d9bc197d4aadf481dd35dc683f2d4d85bc05ab"}
Jul 07 11:38:15.037029 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.036995    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"]
Jul 07 11:38:15.040537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.040517    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:15.043758 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.043732    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4sdbq\""
Jul 07 11:38:15.056753 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.056719    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"]
Jul 07 11:38:15.151325 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.151284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/8f204ab5-5805-4946-9ef1-e502ec397070-kube-api-access-ldskp\") pod \"limitador-operator-controller-manager-859d7b78bd-9m86g\" (UID: \"8f204ab5-5805-4946-9ef1-e502ec397070\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:15.252642 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.252579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/8f204ab5-5805-4946-9ef1-e502ec397070-kube-api-access-ldskp\") pod \"limitador-operator-controller-manager-859d7b78bd-9m86g\" (UID: \"8f204ab5-5805-4946-9ef1-e502ec397070\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:15.270650 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.270600    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/8f204ab5-5805-4946-9ef1-e502ec397070-kube-api-access-ldskp\") pod \"limitador-operator-controller-manager-859d7b78bd-9m86g\" (UID: \"8f204ab5-5805-4946-9ef1-e502ec397070\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:15.304959 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.304868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:15.352396 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.352351    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:15.504808 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:15.504774    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"]
Jul 07 11:38:15.506839 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:15.506809    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f204ab5_5805_4946_9ef1_e502ec397070.slice/crio-cef3be793ef8a88e6b3f90255e2017a412d4c4dc1162be4654e50cf0f6e8dcdc WatchSource:0}: Error finding container cef3be793ef8a88e6b3f90255e2017a412d4c4dc1162be4654e50cf0f6e8dcdc: Status 404 returned error can't find the container with id cef3be793ef8a88e6b3f90255e2017a412d4c4dc1162be4654e50cf0f6e8dcdc
Jul 07 11:38:16.309520 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:16.309436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g" event={"ID":"8f204ab5-5805-4946-9ef1-e502ec397070","Type":"ContainerStarted","Data":"cef3be793ef8a88e6b3f90255e2017a412d4c4dc1162be4654e50cf0f6e8dcdc"}
Jul 07 11:38:17.230682 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:17.230646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:17.298363 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:17.298324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:17.806703 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:17.806564    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:17.872350 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:17.872303    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:19.263348 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:19.263317    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gj7b"
Jul 07 11:38:19.328412 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:19.328363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc" event={"ID":"6ad558a7-f580-440e-a653-ae99162c574d","Type":"ContainerStarted","Data":"dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6"}
Jul 07 11:38:19.328575 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:19.328432    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:19.330223 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:19.330198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g" event={"ID":"8f204ab5-5805-4946-9ef1-e502ec397070","Type":"ContainerStarted","Data":"9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae"}
Jul 07 11:38:19.330359 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:19.330267    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:19.358403 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:19.358350    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc" podStartSLOduration=2.196045224 podStartE2EDuration="7.358333297s" totalImagesPullingTime="5.162288073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:19.357865067 +0000 UTC m=+682.397089796" watchObservedRunningTime="2026-07-07 11:38:19.358333297 +0000 UTC m=+682.397557997"
Jul 07 11:38:19.380118 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:19.380068    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g" podStartSLOduration=1.567630062 podStartE2EDuration="4.380052901s" totalImagesPullingTime="2.812422839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:19.379500578 +0000 UTC m=+682.418725298" watchObservedRunningTime="2026-07-07 11:38:19.380052901 +0000 UTC m=+682.419277601"
Jul 07 11:38:21.108537 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.108505    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"]
Jul 07 11:38:21.111893 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.111872    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.115641 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.115608    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2cjpz\""
Jul 07 11:38:21.116083 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.116063    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 11:38:21.116162 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.116063    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 11:38:21.121200 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.121175    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"]
Jul 07 11:38:21.125242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.125214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:21.205194 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.205155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/909d8717-657e-41c7-bb1b-5b0dcd115b0e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.205384 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.205237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/909d8717-657e-41c7-bb1b-5b0dcd115b0e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.205384 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.205264    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cht8r\" (UniqueName: \"kubernetes.io/projected/909d8717-657e-41c7-bb1b-5b0dcd115b0e-kube-api-access-cht8r\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.268390 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.268347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:21.306680 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.306617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/909d8717-657e-41c7-bb1b-5b0dcd115b0e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.306865 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.306725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/909d8717-657e-41c7-bb1b-5b0dcd115b0e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.306865 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.306746    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cht8r\" (UniqueName: \"kubernetes.io/projected/909d8717-657e-41c7-bb1b-5b0dcd115b0e-kube-api-access-cht8r\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.307363 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.307343    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/909d8717-657e-41c7-bb1b-5b0dcd115b0e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.309287 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.309267    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/909d8717-657e-41c7-bb1b-5b0dcd115b0e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.315180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.315153    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cht8r\" (UniqueName: \"kubernetes.io/projected/909d8717-657e-41c7-bb1b-5b0dcd115b0e-kube-api-access-cht8r\") pod \"kuadrant-console-plugin-66b5774985-zv6bj\" (UID: \"909d8717-657e-41c7-bb1b-5b0dcd115b0e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.421420 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.421393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"
Jul 07 11:38:21.574854 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.574830    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj"]
Jul 07 11:38:21.576364 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:21.576335    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod909d8717_657e_41c7_bb1b_5b0dcd115b0e.slice/crio-cf867fdb048331468e745d3fb829cfa6069c2c359689d1bee6bfba566dd90d95 WatchSource:0}: Error finding container cf867fdb048331468e745d3fb829cfa6069c2c359689d1bee6bfba566dd90d95: Status 404 returned error can't find the container with id cf867fdb048331468e745d3fb829cfa6069c2c359689d1bee6bfba566dd90d95
Jul 07 11:38:21.704983 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.704891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:21.792165 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:21.792131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:22.282097 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:22.282068    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zkp2h"
Jul 07 11:38:22.361204 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:22.361161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj" event={"ID":"909d8717-657e-41c7-bb1b-5b0dcd115b0e","Type":"ContainerStarted","Data":"cf867fdb048331468e745d3fb829cfa6069c2c359689d1bee6bfba566dd90d95"}
Jul 07 11:38:26.009293 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:26.009249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:26.075508 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:26.075466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:30.338119 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:30.338082    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:30.338654 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:30.338179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:31.823432 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:31.823398    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"]
Jul 07 11:38:31.857781 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:31.857727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"]
Jul 07 11:38:31.857954 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:31.857919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:31.915752 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:31.915708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc7afbce-f6be-4614-8f60-40192a9c274c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:31.915945 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:31.915878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xtqs\" (UniqueName: \"kubernetes.io/projected/cc7afbce-f6be-4614-8f60-40192a9c274c-kube-api-access-7xtqs\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:32.016829 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.016793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc7afbce-f6be-4614-8f60-40192a9c274c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:32.017004 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.016904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xtqs\" (UniqueName: \"kubernetes.io/projected/cc7afbce-f6be-4614-8f60-40192a9c274c-kube-api-access-7xtqs\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:32.017201 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.017183    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc7afbce-f6be-4614-8f60-40192a9c274c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:32.027791 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.027751    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xtqs\" (UniqueName: \"kubernetes.io/projected/cc7afbce-f6be-4614-8f60-40192a9c274c-kube-api-access-7xtqs\") pod \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:32.073308 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.073265    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"]
Jul 07 11:38:32.073698 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.073622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:32.083471 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.083439    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"]
Jul 07 11:38:32.093778 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.093744    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"]
Jul 07 11:38:32.094180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.093998    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc" podUID="6ad558a7-f580-440e-a653-ae99162c574d" containerName="manager" containerID="cri-o://dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6" gracePeriod=2
Jul 07 11:38:32.097983 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.097892    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"]
Jul 07 11:38:32.106448 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.106401    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"]
Jul 07 11:38:32.106625 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.106541    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.115807 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:32.115769    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:32.119733 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.119700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"]
Jul 07 11:38:32.124529 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.124499    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"]
Jul 07 11:38:32.124963 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.124753    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" containerName="manager" containerID="cri-o://9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae" gracePeriod=2
Jul 07 11:38:32.128923 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.128891    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"]
Jul 07 11:38:32.129669 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.129604    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ad558a7-f580-440e-a653-ae99162c574d" containerName="manager"
Jul 07 11:38:32.129669 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.129654    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ad558a7-f580-440e-a653-ae99162c574d" containerName="manager"
Jul 07 11:38:32.129846 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.129808    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ad558a7-f580-440e-a653-ae99162c574d" containerName="manager"
Jul 07 11:38:32.135334 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.135308    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.140532 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.140507    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"]
Jul 07 11:38:32.148619 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.148589    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"]
Jul 07 11:38:32.152422 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:32.152237    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:32.154744 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:32.154522    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9m86g\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:32.167446 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.167398    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"]
Jul 07 11:38:32.168145 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.168121    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" containerName="manager"
Jul 07 11:38:32.168241 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.168157    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" containerName="manager"
Jul 07 11:38:32.168299 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.168290    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" containerName="manager"
Jul 07 11:38:32.174174 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.174143    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"
Jul 07 11:38:32.189781 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.189742    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"]
Jul 07 11:38:32.214661 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:32.213286    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:32.215737 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:32.215700    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9m86g\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:32.218905 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.218871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e696a9b-777c-4005-a6ba-ce749a83ba72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j9c6l\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.219090 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.218959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq65z\" (UniqueName: \"kubernetes.io/projected/3e696a9b-777c-4005-a6ba-ce749a83ba72-kube-api-access-cq65z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j9c6l\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.219090 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.219018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fln5p\" (UniqueName: \"kubernetes.io/projected/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-kube-api-access-fln5p\") pod \"kuadrant-operator-controller-manager-55467d9f7-qbqqp\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.219090 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.219056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khs5c\" (UniqueName: \"kubernetes.io/projected/6031e811-52cf-40e7-a97d-892ba6392334-kube-api-access-khs5c\") pod \"limitador-operator-controller-manager-859d7b78bd-g847w\" (UID: \"6031e811-52cf-40e7-a97d-892ba6392334\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"
Jul 07 11:38:32.219936 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.219090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qbqqp\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.320100 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.320064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fln5p\" (UniqueName: \"kubernetes.io/projected/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-kube-api-access-fln5p\") pod \"kuadrant-operator-controller-manager-55467d9f7-qbqqp\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.320372 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.320120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khs5c\" (UniqueName: \"kubernetes.io/projected/6031e811-52cf-40e7-a97d-892ba6392334-kube-api-access-khs5c\") pod \"limitador-operator-controller-manager-859d7b78bd-g847w\" (UID: \"6031e811-52cf-40e7-a97d-892ba6392334\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"
Jul 07 11:38:32.320372 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.320160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qbqqp\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.320372 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.320248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e696a9b-777c-4005-a6ba-ce749a83ba72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j9c6l\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.320372 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.320292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq65z\" (UniqueName: \"kubernetes.io/projected/3e696a9b-777c-4005-a6ba-ce749a83ba72-kube-api-access-cq65z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j9c6l\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.320647 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.320616    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qbqqp\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.320737 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.320716    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e696a9b-777c-4005-a6ba-ce749a83ba72-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j9c6l\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.335116 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.335046    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fln5p\" (UniqueName: \"kubernetes.io/projected/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-kube-api-access-fln5p\") pod \"kuadrant-operator-controller-manager-55467d9f7-qbqqp\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.335116 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.335070    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khs5c\" (UniqueName: \"kubernetes.io/projected/6031e811-52cf-40e7-a97d-892ba6392334-kube-api-access-khs5c\") pod \"limitador-operator-controller-manager-859d7b78bd-g847w\" (UID: \"6031e811-52cf-40e7-a97d-892ba6392334\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"
Jul 07 11:38:32.335116 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.335046    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq65z\" (UniqueName: \"kubernetes.io/projected/3e696a9b-777c-4005-a6ba-ce749a83ba72-kube-api-access-cq65z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j9c6l\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.512644 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.512604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:32.523336 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.523277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:32.531478 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:32.531448    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"
Jul 07 11:38:34.253924 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:34.253883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:34.348240 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:34.348186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:37.818490 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:37.818456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:37.889184 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:37.889146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:38.028807 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:38.028767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:38.164148 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:38.164050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:41.812377 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:41.812330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:41.875034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:41.874871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:43.936156 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:43.936080    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"]
Jul 07 11:38:43.939365 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:43.939331    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1290a4_7a63_44fa_9b73_c1488f1ca0ff.slice/crio-631cbaa48eca0490c3b1f2dc94f9e9df3bee9b5aa0df95b4152894b163ab22d4 WatchSource:0}: Error finding container 631cbaa48eca0490c3b1f2dc94f9e9df3bee9b5aa0df95b4152894b163ab22d4: Status 404 returned error can't find the container with id 631cbaa48eca0490c3b1f2dc94f9e9df3bee9b5aa0df95b4152894b163ab22d4
Jul 07 11:38:43.955614 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:43.955554    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:43.958259 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:43.958235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"]
Jul 07 11:38:43.958368 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:43.958231    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:43.960824 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:43.960795    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e696a9b_777c_4005_a6ba_ce749a83ba72.slice/crio-207f50f9cba1abe7f2acfb3d9bddcece54b3d8c651f52356f665304c043ba851 WatchSource:0}: Error finding container 207f50f9cba1abe7f2acfb3d9bddcece54b3d8c651f52356f665304c043ba851: Status 404 returned error can't find the container with id 207f50f9cba1abe7f2acfb3d9bddcece54b3d8c651f52356f665304c043ba851
Jul 07 11:38:43.980715 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:43.980697    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:43.980776 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:43.980723    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"]
Jul 07 11:38:43.982890 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:43.982862    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6031e811_52cf_40e7_a97d_892ba6392334.slice/crio-92d8461a104732cbe33b29338e9ea0f9a9098acd4a837bbf5334b15a4d5c50cc WatchSource:0}: Error finding container 92d8461a104732cbe33b29338e9ea0f9a9098acd4a837bbf5334b15a4d5c50cc: Status 404 returned error can't find the container with id 92d8461a104732cbe33b29338e9ea0f9a9098acd4a837bbf5334b15a4d5c50cc
Jul 07 11:38:43.983086 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:43.983053    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:43.985111 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:43.985081    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9m86g\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:44.035724 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.035694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42qgj\" (UniqueName: \"kubernetes.io/projected/6ad558a7-f580-440e-a653-ae99162c574d-kube-api-access-42qgj\") pod \"6ad558a7-f580-440e-a653-ae99162c574d\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") "
Jul 07 11:38:44.035846 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.035798    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/8f204ab5-5805-4946-9ef1-e502ec397070-kube-api-access-ldskp\") pod \"8f204ab5-5805-4946-9ef1-e502ec397070\" (UID: \"8f204ab5-5805-4946-9ef1-e502ec397070\") "
Jul 07 11:38:44.035886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.035848    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad558a7-f580-440e-a653-ae99162c574d-extensions-socket-volume\") pod \"6ad558a7-f580-440e-a653-ae99162c574d\" (UID: \"6ad558a7-f580-440e-a653-ae99162c574d\") "
Jul 07 11:38:44.036437 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.036377    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad558a7-f580-440e-a653-ae99162c574d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6ad558a7-f580-440e-a653-ae99162c574d" (UID: "6ad558a7-f580-440e-a653-ae99162c574d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:38:44.038009 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.037985    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f204ab5-5805-4946-9ef1-e502ec397070-kube-api-access-ldskp" (OuterVolumeSpecName: "kube-api-access-ldskp") pod "8f204ab5-5805-4946-9ef1-e502ec397070" (UID: "8f204ab5-5805-4946-9ef1-e502ec397070"). InnerVolumeSpecName "kube-api-access-ldskp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:38:44.038009 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.037992    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ad558a7-f580-440e-a653-ae99162c574d-kube-api-access-42qgj" (OuterVolumeSpecName: "kube-api-access-42qgj") pod "6ad558a7-f580-440e-a653-ae99162c574d" (UID: "6ad558a7-f580-440e-a653-ae99162c574d"). InnerVolumeSpecName "kube-api-access-42qgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:38:44.137289 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.137260    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42qgj\" (UniqueName: \"kubernetes.io/projected/6ad558a7-f580-440e-a653-ae99162c574d-kube-api-access-42qgj\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:38:44.137289 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.137287    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/8f204ab5-5805-4946-9ef1-e502ec397070-kube-api-access-ldskp\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:38:44.137289 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.137296    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ad558a7-f580-440e-a653-ae99162c574d-extensions-socket-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:38:44.499724 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.499690    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ad558a7-f580-440e-a653-ae99162c574d" containerID="dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6" exitCode=0
Jul 07 11:38:44.499926 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.499732    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:44.499926 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.499793    2564 scope.go:117] "RemoveContainer" containerID="dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6"
Jul 07 11:38:44.502700 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.502666    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:44.504839 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.504808    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9m86g\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:44.510181 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.510148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp" event={"ID":"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff","Type":"ContainerStarted","Data":"a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d"}
Jul 07 11:38:44.510298 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.510241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp" event={"ID":"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff","Type":"ContainerStarted","Data":"631cbaa48eca0490c3b1f2dc94f9e9df3bee9b5aa0df95b4152894b163ab22d4"}
Jul 07 11:38:44.510883 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.510806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:44.512846 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.512817    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:44.512981 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.512831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj" event={"ID":"909d8717-657e-41c7-bb1b-5b0dcd115b0e","Type":"ContainerStarted","Data":"60792085d92f6a321e0c8563c845c99eb63a89559f05793ca55f36156538e640"}
Jul 07 11:38:44.514612 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.514588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l" event={"ID":"3e696a9b-777c-4005-a6ba-ce749a83ba72","Type":"ContainerStarted","Data":"d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22"}
Jul 07 11:38:44.514741 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.514652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l" event={"ID":"3e696a9b-777c-4005-a6ba-ce749a83ba72","Type":"ContainerStarted","Data":"207f50f9cba1abe7f2acfb3d9bddcece54b3d8c651f52356f665304c043ba851"}
Jul 07 11:38:44.514741 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.514675    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:44.514869 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.514838    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9m86g\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:44.515487 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.515469    2564 scope.go:117] "RemoveContainer" containerID="dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6"
Jul 07 11:38:44.515803 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.515783    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6\": container with ID starting with dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6 not found: ID does not exist" containerID="dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6"
Jul 07 11:38:44.515860 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.515812    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6"} err="failed to get container status \"dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6\": rpc error: code = NotFound desc = could not find container \"dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6\": container with ID starting with dbba122681073eedea21ddd36bc8a1dcc7d1bc911d6130defc7c2b3393967db6 not found: ID does not exist"
Jul 07 11:38:44.516154 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.516133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w" event={"ID":"6031e811-52cf-40e7-a97d-892ba6392334","Type":"ContainerStarted","Data":"99bdc14a500b5c55ea40d722f99d47d6eff0324b638fccc839d9ff0825247f05"}
Jul 07 11:38:44.516202 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.516175    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w" event={"ID":"6031e811-52cf-40e7-a97d-892ba6392334","Type":"ContainerStarted","Data":"92d8461a104732cbe33b29338e9ea0f9a9098acd4a837bbf5334b15a4d5c50cc"}
Jul 07 11:38:44.516202 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.516194    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"
Jul 07 11:38:44.517400 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.517380    2564 generic.go:356] "Generic (PLEG): container finished" podID="8f204ab5-5805-4946-9ef1-e502ec397070" containerID="9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae" exitCode=0
Jul 07 11:38:44.517501 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.517427    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:44.517501 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.517469    2564 scope.go:117] "RemoveContainer" containerID="9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae"
Jul 07 11:38:44.527469 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.527449    2564 scope.go:117] "RemoveContainer" containerID="9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae"
Jul 07 11:38:44.527799 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.527779    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae\": container with ID starting with 9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae not found: ID does not exist" containerID="9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae"
Jul 07 11:38:44.527854 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.527807    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae"} err="failed to get container status \"9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae\": rpc error: code = NotFound desc = could not find container \"9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae\": container with ID starting with 9623c9d5905a2bf0614756c9b6507b2d83f5a6ca78b2214b6c46955b18cfdbae not found: ID does not exist"
Jul 07 11:38:44.535008 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.534947    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp" podStartSLOduration=12.534923163 podStartE2EDuration="12.534923163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:44.532747331 +0000 UTC m=+707.571972042" watchObservedRunningTime="2026-07-07 11:38:44.534923163 +0000 UTC m=+707.574147863"
Jul 07 11:38:44.549762 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.549701    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6bj" podStartSLOduration=1.16641941 podStartE2EDuration="23.549684959s" totalImagesPullingTime="22.383265549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:44.547895762 +0000 UTC m=+707.587120465" watchObservedRunningTime="2026-07-07 11:38:44.549684959 +0000 UTC m=+707.588909661"
Jul 07 11:38:44.568290 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.568222    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l" podStartSLOduration=12.568199197 podStartE2EDuration="12.568199197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:44.566531717 +0000 UTC m=+707.605756421" watchObservedRunningTime="2026-07-07 11:38:44.568199197 +0000 UTC m=+707.607423899"
Jul 07 11:38:44.587650 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:44.587567    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w" podStartSLOduration=12.587544378 podStartE2EDuration="12.587544378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:44.587030229 +0000 UTC m=+707.626254940" watchObservedRunningTime="2026-07-07 11:38:44.587544378 +0000 UTC m=+707.626769081"
Jul 07 11:38:44.589387 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.589352    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5hxqc\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="6ad558a7-f580-440e-a653-ae99162c574d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5hxqc"
Jul 07 11:38:44.591364 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:44.591337    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9m86g\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9m86g"
Jul 07 11:38:45.418763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:45.418730    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ad558a7-f580-440e-a653-ae99162c574d" path="/var/lib/kubelet/pods/6ad558a7-f580-440e-a653-ae99162c574d/volumes"
Jul 07 11:38:45.419150 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:45.419069    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f204ab5-5805-4946-9ef1-e502ec397070" path="/var/lib/kubelet/pods/8f204ab5-5805-4946-9ef1-e502ec397070/volumes"
Jul 07 11:38:46.284373 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:46.284329    2564 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fwq4d_kuadrant-system_cc7afbce-f6be-4614-8f60-40192a9c274c_0(ea6a1905146e5614053a628b91c2e22c2dc684b4a6db4aa538a0b778c51b67c4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fwq4d to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 07 11:38:46.284529 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:46.284401    2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fwq4d_kuadrant-system_cc7afbce-f6be-4614-8f60-40192a9c274c_0(ea6a1905146e5614053a628b91c2e22c2dc684b4a6db4aa538a0b778c51b67c4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fwq4d to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:46.530736 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.530653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:46.532935 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:46.532905    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="cc7afbce-f6be-4614-8f60-40192a9c274c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:46.607171 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.607125    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:46.609712 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:46.609664    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="cc7afbce-f6be-4614-8f60-40192a9c274c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:46.660676 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.660623    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xtqs\" (UniqueName: \"kubernetes.io/projected/cc7afbce-f6be-4614-8f60-40192a9c274c-kube-api-access-7xtqs\") pod \"cc7afbce-f6be-4614-8f60-40192a9c274c\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") "
Jul 07 11:38:46.660835 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.660790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc7afbce-f6be-4614-8f60-40192a9c274c-extensions-socket-volume\") pod \"cc7afbce-f6be-4614-8f60-40192a9c274c\" (UID: \"cc7afbce-f6be-4614-8f60-40192a9c274c\") "
Jul 07 11:38:46.661074 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.661040    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7afbce-f6be-4614-8f60-40192a9c274c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc7afbce-f6be-4614-8f60-40192a9c274c" (UID: "cc7afbce-f6be-4614-8f60-40192a9c274c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:38:46.662957 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.662921    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7afbce-f6be-4614-8f60-40192a9c274c-kube-api-access-7xtqs" (OuterVolumeSpecName: "kube-api-access-7xtqs") pod "cc7afbce-f6be-4614-8f60-40192a9c274c" (UID: "cc7afbce-f6be-4614-8f60-40192a9c274c"). InnerVolumeSpecName "kube-api-access-7xtqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:38:46.761358 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.761319    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc7afbce-f6be-4614-8f60-40192a9c274c-extensions-socket-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:38:46.761358 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:46.761351    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xtqs\" (UniqueName: \"kubernetes.io/projected/cc7afbce-f6be-4614-8f60-40192a9c274c-kube-api-access-7xtqs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:38:47.229479 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:47.229438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:47.301499 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:47.301460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:47.417567 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:47.417531    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="cc7afbce-f6be-4614-8f60-40192a9c274c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:47.419182 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:47.419160    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7afbce-f6be-4614-8f60-40192a9c274c" path="/var/lib/kubelet/pods/cc7afbce-f6be-4614-8f60-40192a9c274c/volumes"
Jul 07 11:38:47.535267 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:47.535160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:47.537840 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:47.537811    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="cc7afbce-f6be-4614-8f60-40192a9c274c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:47.540179 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:47.540155    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fwq4d\" is forbidden: User \"system:node:ip-10-0-129-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-12.ec2.internal' and this object" podUID="cc7afbce-f6be-4614-8f60-40192a9c274c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fwq4d"
Jul 07 11:38:49.542151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:49.542114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:49.597418 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:49.597382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:54.225254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:54.225195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:54.323238 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:54.323201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:55.527177 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.527145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:38:55.527714 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.527446    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g847w"
Jul 07 11:38:55.528007 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.527985    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:55.606421 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.606386    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"]
Jul 07 11:38:55.606910 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.606876    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l" podUID="3e696a9b-777c-4005-a6ba-ce749a83ba72" containerName="manager" containerID="cri-o://d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22" gracePeriod=10
Jul 07 11:38:55.926390 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.926355    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"]
Jul 07 11:38:55.929025 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.929003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:55.956667 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:55.956614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"]
Jul 07 11:38:56.046763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.046721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19c565-652f-4b8a-9c01-5ca5834cb215-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d9qbv\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.046763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.046763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5gh\" (UniqueName: \"kubernetes.io/projected/5c19c565-652f-4b8a-9c01-5ca5834cb215-kube-api-access-nd5gh\") pod \"kuadrant-operator-controller-manager-86878c769f-d9qbv\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.148407 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.148311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19c565-652f-4b8a-9c01-5ca5834cb215-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d9qbv\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.148407 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.148352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5gh\" (UniqueName: \"kubernetes.io/projected/5c19c565-652f-4b8a-9c01-5ca5834cb215-kube-api-access-nd5gh\") pod \"kuadrant-operator-controller-manager-86878c769f-d9qbv\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.148721 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.148699    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19c565-652f-4b8a-9c01-5ca5834cb215-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d9qbv\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.161434 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.161410    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5gh\" (UniqueName: \"kubernetes.io/projected/5c19c565-652f-4b8a-9c01-5ca5834cb215-kube-api-access-nd5gh\") pod \"kuadrant-operator-controller-manager-86878c769f-d9qbv\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.239575 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.239544    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.389320 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.389280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:56.398529 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.398470    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:56.429526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.429491    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"]
Jul 07 11:38:56.431891 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:38:56.431859    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c19c565_652f_4b8a_9c01_5ca5834cb215.slice/crio-82fdb19dadd017aaf5ba6e2826e5dbea2332103591792c0447be517d42616495 WatchSource:0}: Error finding container 82fdb19dadd017aaf5ba6e2826e5dbea2332103591792c0447be517d42616495: Status 404 returned error can't find the container with id 82fdb19dadd017aaf5ba6e2826e5dbea2332103591792c0447be517d42616495
Jul 07 11:38:56.481882 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.481844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:38:56.552869 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.552833    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e696a9b-777c-4005-a6ba-ce749a83ba72-extensions-socket-volume\") pod \"3e696a9b-777c-4005-a6ba-ce749a83ba72\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") "
Jul 07 11:38:56.552869 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.552869    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq65z\" (UniqueName: \"kubernetes.io/projected/3e696a9b-777c-4005-a6ba-ce749a83ba72-kube-api-access-cq65z\") pod \"3e696a9b-777c-4005-a6ba-ce749a83ba72\" (UID: \"3e696a9b-777c-4005-a6ba-ce749a83ba72\") "
Jul 07 11:38:56.553281 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.553256    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e696a9b-777c-4005-a6ba-ce749a83ba72-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e696a9b-777c-4005-a6ba-ce749a83ba72" (UID: "3e696a9b-777c-4005-a6ba-ce749a83ba72"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:38:56.555160 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.555137    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e696a9b-777c-4005-a6ba-ce749a83ba72-kube-api-access-cq65z" (OuterVolumeSpecName: "kube-api-access-cq65z") pod "3e696a9b-777c-4005-a6ba-ce749a83ba72" (UID: "3e696a9b-777c-4005-a6ba-ce749a83ba72"). InnerVolumeSpecName "kube-api-access-cq65z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:38:56.585536 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.585495    2564 generic.go:356] "Generic (PLEG): container finished" podID="3e696a9b-777c-4005-a6ba-ce749a83ba72" containerID="d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22" exitCode=0
Jul 07 11:38:56.585536 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.585540    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"
Jul 07 11:38:56.585774 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.585573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l" event={"ID":"3e696a9b-777c-4005-a6ba-ce749a83ba72","Type":"ContainerDied","Data":"d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22"}
Jul 07 11:38:56.585774 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.585656    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l" event={"ID":"3e696a9b-777c-4005-a6ba-ce749a83ba72","Type":"ContainerDied","Data":"207f50f9cba1abe7f2acfb3d9bddcece54b3d8c651f52356f665304c043ba851"}
Jul 07 11:38:56.585774 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.585665    2564 scope.go:117] "RemoveContainer" containerID="d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22"
Jul 07 11:38:56.587562 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.587536    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv" event={"ID":"5c19c565-652f-4b8a-9c01-5ca5834cb215","Type":"ContainerStarted","Data":"21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d"}
Jul 07 11:38:56.587674 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.587592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv" event={"ID":"5c19c565-652f-4b8a-9c01-5ca5834cb215","Type":"ContainerStarted","Data":"82fdb19dadd017aaf5ba6e2826e5dbea2332103591792c0447be517d42616495"}
Jul 07 11:38:56.587857 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.587840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:38:56.595393 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.595375    2564 scope.go:117] "RemoveContainer" containerID="d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22"
Jul 07 11:38:56.595799 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:38:56.595780    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22\": container with ID starting with d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22 not found: ID does not exist" containerID="d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22"
Jul 07 11:38:56.595853 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.595807    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22"} err="failed to get container status \"d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22\": rpc error: code = NotFound desc = could not find container \"d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22\": container with ID starting with d7fe320df8c2fb533d721737482a4794111bb0333711eaae07bd6e2d8d6e1a22 not found: ID does not exist"
Jul 07 11:38:56.617932 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.617881    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv" podStartSLOduration=1.617865635 podStartE2EDuration="1.617865635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:38:56.616401165 +0000 UTC m=+719.655625866" watchObservedRunningTime="2026-07-07 11:38:56.617865635 +0000 UTC m=+719.657090336"
Jul 07 11:38:56.635497 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.635457    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"]
Jul 07 11:38:56.643880 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.643848    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j9c6l"]
Jul 07 11:38:56.654195 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.654114    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e696a9b-777c-4005-a6ba-ce749a83ba72-extensions-socket-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:38:56.654195 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:56.654141    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq65z\" (UniqueName: \"kubernetes.io/projected/3e696a9b-777c-4005-a6ba-ce749a83ba72-kube-api-access-cq65z\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:38:57.419358 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:38:57.419329    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e696a9b-777c-4005-a6ba-ce749a83ba72" path="/var/lib/kubelet/pods/3e696a9b-777c-4005-a6ba-ce749a83ba72/volumes"
Jul 07 11:39:00.433193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:00.433152    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58645b9448-h6rlw"]
Jul 07 11:39:00.536426 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:00.536391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:00.633811 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:00.633771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:07.595417 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:07.595387    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:39:07.647570 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:07.647537    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"]
Jul 07 11:39:07.647789 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:07.647766    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp" podUID="ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" containerName="manager" containerID="cri-o://a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d" gracePeriod=10
Jul 07 11:39:07.912201 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:07.912176    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:39:08.054921 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.054883    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-extensions-socket-volume\") pod \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") "
Jul 07 11:39:08.055170 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.054952    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fln5p\" (UniqueName: \"kubernetes.io/projected/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-kube-api-access-fln5p\") pod \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\" (UID: \"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff\") "
Jul 07 11:39:08.055270 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.055248    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" (UID: "ba1290a4-7a63-44fa-9b73-c1488f1ca0ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:39:08.057172 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.057143    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-kube-api-access-fln5p" (OuterVolumeSpecName: "kube-api-access-fln5p") pod "ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" (UID: "ba1290a4-7a63-44fa-9b73-c1488f1ca0ff"). InnerVolumeSpecName "kube-api-access-fln5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:39:08.156055 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.155965    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fln5p\" (UniqueName: \"kubernetes.io/projected/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-kube-api-access-fln5p\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:08.156055 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.155994    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff-extensions-socket-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:08.649110 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.649076    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" containerID="a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d" exitCode=0
Jul 07 11:39:08.649573 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.649119    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"
Jul 07 11:39:08.649573 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.649135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp" event={"ID":"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff","Type":"ContainerDied","Data":"a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d"}
Jul 07 11:39:08.649573 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.649179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp" event={"ID":"ba1290a4-7a63-44fa-9b73-c1488f1ca0ff","Type":"ContainerDied","Data":"631cbaa48eca0490c3b1f2dc94f9e9df3bee9b5aa0df95b4152894b163ab22d4"}
Jul 07 11:39:08.649573 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.649201    2564 scope.go:117] "RemoveContainer" containerID="a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d"
Jul 07 11:39:08.658970 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.658949    2564 scope.go:117] "RemoveContainer" containerID="a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d"
Jul 07 11:39:08.659224 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:39:08.659206    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d\": container with ID starting with a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d not found: ID does not exist" containerID="a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d"
Jul 07 11:39:08.659285 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.659234    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d"} err="failed to get container status \"a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d\": rpc error: code = NotFound desc = could not find container \"a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d\": container with ID starting with a43e72fb82e0a100a5636ac0ef0b5094a8f3a3fc5c3730181e2873bd5704ba6d not found: ID does not exist"
Jul 07 11:39:08.671588 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.671565    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"]
Jul 07 11:39:08.682987 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:08.682958    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qbqqp"]
Jul 07 11:39:09.418669 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:09.418611    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" path="/var/lib/kubelet/pods/ba1290a4-7a63-44fa-9b73-c1488f1ca0ff/volumes"
Jul 07 11:39:12.054870 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:12.054840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:12.157386 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:12.157350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:12.379078 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:12.378998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:25.455059 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.454995    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58645b9448-h6rlw" podUID="1d280b57-2aed-4010-ac4c-3f7f5a45379d" containerName="console" containerID="cri-o://7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac" gracePeriod=15
Jul 07 11:39:25.708237 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.708164    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:39:25.737817 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.737784    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d280b57-2aed-4010-ac4c-3f7f5a45379d" containerID="7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac" exitCode=0
Jul 07 11:39:25.737974 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.737834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58645b9448-h6rlw" event={"ID":"1d280b57-2aed-4010-ac4c-3f7f5a45379d","Type":"ContainerDied","Data":"7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac"}
Jul 07 11:39:25.737974 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.737842    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58645b9448-h6rlw"
Jul 07 11:39:25.737974 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.737881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58645b9448-h6rlw" event={"ID":"1d280b57-2aed-4010-ac4c-3f7f5a45379d","Type":"ContainerDied","Data":"90ccaddba18078de9a835d7103034d1b1ba9de432022e2cdb0dcc8ce989ae581"}
Jul 07 11:39:25.737974 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.737906    2564 scope.go:117] "RemoveContainer" containerID="7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac"
Jul 07 11:39:25.748372 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.748351    2564 scope.go:117] "RemoveContainer" containerID="7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac"
Jul 07 11:39:25.748716 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:39:25.748684    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac\": container with ID starting with 7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac not found: ID does not exist" containerID="7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac"
Jul 07 11:39:25.748829 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.748726    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac"} err="failed to get container status \"7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac\": rpc error: code = NotFound desc = could not find container \"7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac\": container with ID starting with 7e71682a23604ce829d0cadeea97020be95db79ec616d804555b5e7acb444fac not found: ID does not exist"
Jul 07 11:39:25.806817 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.806785    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-serving-cert\") pod \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") "
Jul 07 11:39:25.806985 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.806850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-config\") pod \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") "
Jul 07 11:39:25.806985 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.806905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-service-ca\") pod \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") "
Jul 07 11:39:25.806985 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.806947    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-oauth-config\") pod \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") "
Jul 07 11:39:25.807145 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.806997    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k25xm\" (UniqueName: \"kubernetes.io/projected/1d280b57-2aed-4010-ac4c-3f7f5a45379d-kube-api-access-k25xm\") pod \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") "
Jul 07 11:39:25.807145 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.807035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-oauth-serving-cert\") pod \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") "
Jul 07 11:39:25.807145 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.807067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-trusted-ca-bundle\") pod \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\" (UID: \"1d280b57-2aed-4010-ac4c-3f7f5a45379d\") "
Jul 07 11:39:25.807386 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.807355    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-config" (OuterVolumeSpecName: "console-config") pod "1d280b57-2aed-4010-ac4c-3f7f5a45379d" (UID: "1d280b57-2aed-4010-ac4c-3f7f5a45379d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:39:25.807469 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.807364    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-service-ca" (OuterVolumeSpecName: "service-ca") pod "1d280b57-2aed-4010-ac4c-3f7f5a45379d" (UID: "1d280b57-2aed-4010-ac4c-3f7f5a45379d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:39:25.807535 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.807428    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1d280b57-2aed-4010-ac4c-3f7f5a45379d" (UID: "1d280b57-2aed-4010-ac4c-3f7f5a45379d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:39:25.807876 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.807723    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1d280b57-2aed-4010-ac4c-3f7f5a45379d" (UID: "1d280b57-2aed-4010-ac4c-3f7f5a45379d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:39:25.809322 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.809298    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1d280b57-2aed-4010-ac4c-3f7f5a45379d" (UID: "1d280b57-2aed-4010-ac4c-3f7f5a45379d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:39:25.809322 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.809301    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d280b57-2aed-4010-ac4c-3f7f5a45379d-kube-api-access-k25xm" (OuterVolumeSpecName: "kube-api-access-k25xm") pod "1d280b57-2aed-4010-ac4c-3f7f5a45379d" (UID: "1d280b57-2aed-4010-ac4c-3f7f5a45379d"). InnerVolumeSpecName "kube-api-access-k25xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:39:25.809449 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.809381    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1d280b57-2aed-4010-ac4c-3f7f5a45379d" (UID: "1d280b57-2aed-4010-ac4c-3f7f5a45379d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:39:25.907980 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.907944    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:25.907980 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.907977    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:25.907980 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.907987    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k25xm\" (UniqueName: \"kubernetes.io/projected/1d280b57-2aed-4010-ac4c-3f7f5a45379d-kube-api-access-k25xm\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:25.908216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.907997    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:25.908216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.908005    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:25.908216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.908014    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:25.908216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:25.908022    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1d280b57-2aed-4010-ac4c-3f7f5a45379d-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:26.060771 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.060730    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58645b9448-h6rlw"]
Jul 07 11:39:26.065154 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.065121    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58645b9448-h6rlw"]
Jul 07 11:39:26.119133 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.119095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:26.123105 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123078    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"]
Jul 07 11:39:26.123481 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123469    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d280b57-2aed-4010-ac4c-3f7f5a45379d" containerName="console"
Jul 07 11:39:26.123526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123483    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d280b57-2aed-4010-ac4c-3f7f5a45379d" containerName="console"
Jul 07 11:39:26.123526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123492    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e696a9b-777c-4005-a6ba-ce749a83ba72" containerName="manager"
Jul 07 11:39:26.123526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123497    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e696a9b-777c-4005-a6ba-ce749a83ba72" containerName="manager"
Jul 07 11:39:26.123526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123508    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" containerName="manager"
Jul 07 11:39:26.123526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123512    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" containerName="manager"
Jul 07 11:39:26.123702 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123580    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e696a9b-777c-4005-a6ba-ce749a83ba72" containerName="manager"
Jul 07 11:39:26.123702 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123592    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1290a4-7a63-44fa-9b73-c1488f1ca0ff" containerName="manager"
Jul 07 11:39:26.123702 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.123599    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d280b57-2aed-4010-ac4c-3f7f5a45379d" containerName="console"
Jul 07 11:39:26.126190 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.126175    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.128900 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.128886    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 11:39:26.134216 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.134192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"]
Jul 07 11:39:26.211153 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.211119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf54ce51-0c40-44ec-972b-cab0d43e374f-config-file\") pod \"limitador-limitador-64c94fd64f-6jrkc\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.211341 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.211168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxpj\" (UniqueName: \"kubernetes.io/projected/bf54ce51-0c40-44ec-972b-cab0d43e374f-kube-api-access-dzxpj\") pod \"limitador-limitador-64c94fd64f-6jrkc\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.221574 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.221512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"]
Jul 07 11:39:26.236279 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.236238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:26.294301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.294265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:26.312696 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.312575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf54ce51-0c40-44ec-972b-cab0d43e374f-config-file\") pod \"limitador-limitador-64c94fd64f-6jrkc\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.312696 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.312624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxpj\" (UniqueName: \"kubernetes.io/projected/bf54ce51-0c40-44ec-972b-cab0d43e374f-kube-api-access-dzxpj\") pod \"limitador-limitador-64c94fd64f-6jrkc\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.313263 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.313239    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf54ce51-0c40-44ec-972b-cab0d43e374f-config-file\") pod \"limitador-limitador-64c94fd64f-6jrkc\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.325693 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.325666    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxpj\" (UniqueName: \"kubernetes.io/projected/bf54ce51-0c40-44ec-972b-cab0d43e374f-kube-api-access-dzxpj\") pod \"limitador-limitador-64c94fd64f-6jrkc\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.437865 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.437824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:26.588147 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.588116    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"]
Jul 07 11:39:26.589753 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:39:26.589726    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf54ce51_0c40_44ec_972b_cab0d43e374f.slice/crio-610a0b87b74db8352018e0853bd1d16ed549f34d339bdc91c2d5f0d892578749 WatchSource:0}: Error finding container 610a0b87b74db8352018e0853bd1d16ed549f34d339bdc91c2d5f0d892578749: Status 404 returned error can't find the container with id 610a0b87b74db8352018e0853bd1d16ed549f34d339bdc91c2d5f0d892578749
Jul 07 11:39:26.744935 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.744902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc" event={"ID":"bf54ce51-0c40-44ec-972b-cab0d43e374f","Type":"ContainerStarted","Data":"610a0b87b74db8352018e0853bd1d16ed549f34d339bdc91c2d5f0d892578749"}
Jul 07 11:39:26.938179 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.938142    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-cp6mp"]
Jul 07 11:39:26.941348 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.941326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cp6mp"
Jul 07 11:39:26.944152 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.944124    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qxgqn\""
Jul 07 11:39:26.949097 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.949070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cp6mp"]
Jul 07 11:39:26.981786 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:26.981757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:27.020118 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.020082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz2jw\" (UniqueName: \"kubernetes.io/projected/ff411fff-0189-4cd1-bb06-d0780f3a3fdc-kube-api-access-bz2jw\") pod \"authorino-58cd955675-cp6mp\" (UID: \"ff411fff-0189-4cd1-bb06-d0780f3a3fdc\") " pod="kuadrant-system/authorino-58cd955675-cp6mp"
Jul 07 11:39:27.083468 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.083423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:27.120908 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.120875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz2jw\" (UniqueName: \"kubernetes.io/projected/ff411fff-0189-4cd1-bb06-d0780f3a3fdc-kube-api-access-bz2jw\") pod \"authorino-58cd955675-cp6mp\" (UID: \"ff411fff-0189-4cd1-bb06-d0780f3a3fdc\") " pod="kuadrant-system/authorino-58cd955675-cp6mp"
Jul 07 11:39:27.130240 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.130207    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz2jw\" (UniqueName: \"kubernetes.io/projected/ff411fff-0189-4cd1-bb06-d0780f3a3fdc-kube-api-access-bz2jw\") pod \"authorino-58cd955675-cp6mp\" (UID: \"ff411fff-0189-4cd1-bb06-d0780f3a3fdc\") " pod="kuadrant-system/authorino-58cd955675-cp6mp"
Jul 07 11:39:27.252771 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.252692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cp6mp"
Jul 07 11:39:27.432236 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.432194    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d280b57-2aed-4010-ac4c-3f7f5a45379d" path="/var/lib/kubelet/pods/1d280b57-2aed-4010-ac4c-3f7f5a45379d/volumes"
Jul 07 11:39:27.450747 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.450710    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cp6mp"]
Jul 07 11:39:27.455108 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:39:27.455071    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff411fff_0189_4cd1_bb06_d0780f3a3fdc.slice/crio-08b914707d50c91e020792596c9ee3869cb32a93d3f64ea5530ca7413bb9d159 WatchSource:0}: Error finding container 08b914707d50c91e020792596c9ee3869cb32a93d3f64ea5530ca7413bb9d159: Status 404 returned error can't find the container with id 08b914707d50c91e020792596c9ee3869cb32a93d3f64ea5530ca7413bb9d159
Jul 07 11:39:27.753226 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:27.753178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cp6mp" event={"ID":"ff411fff-0189-4cd1-bb06-d0780f3a3fdc","Type":"ContainerStarted","Data":"08b914707d50c91e020792596c9ee3869cb32a93d3f64ea5530ca7413bb9d159"}
Jul 07 11:39:30.948805 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:30.948766    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cp6mp"]
Jul 07 11:39:31.785835 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:31.785788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cp6mp" event={"ID":"ff411fff-0189-4cd1-bb06-d0780f3a3fdc","Type":"ContainerStarted","Data":"02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853"}
Jul 07 11:39:31.786056 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:31.785908    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-cp6mp" podUID="ff411fff-0189-4cd1-bb06-d0780f3a3fdc" containerName="authorino" containerID="cri-o://02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853" gracePeriod=30
Jul 07 11:39:31.787588 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:31.787558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc" event={"ID":"bf54ce51-0c40-44ec-972b-cab0d43e374f","Type":"ContainerStarted","Data":"21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8"}
Jul 07 11:39:31.787760 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:31.787745    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:31.806373 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:31.806329    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-cp6mp" podStartSLOduration=2.032019374 podStartE2EDuration="5.806312754s" totalImagesPullingTime="3.77429338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:39:31.804442108 +0000 UTC m=+754.843666811" watchObservedRunningTime="2026-07-07 11:39:31.806312754 +0000 UTC m=+754.845537455"
Jul 07 11:39:31.826222 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:31.826166    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc" podStartSLOduration=1.235438254 podStartE2EDuration="5.826147423s" totalImagesPullingTime="4.590709169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:39:31.825577248 +0000 UTC m=+754.864801992" watchObservedRunningTime="2026-07-07 11:39:31.826147423 +0000 UTC m=+754.865372124"
Jul 07 11:39:32.046305 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.046230    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cp6mp"
Jul 07 11:39:32.081421 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.081388    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz2jw\" (UniqueName: \"kubernetes.io/projected/ff411fff-0189-4cd1-bb06-d0780f3a3fdc-kube-api-access-bz2jw\") pod \"ff411fff-0189-4cd1-bb06-d0780f3a3fdc\" (UID: \"ff411fff-0189-4cd1-bb06-d0780f3a3fdc\") "
Jul 07 11:39:32.083621 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.083599    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff411fff-0189-4cd1-bb06-d0780f3a3fdc-kube-api-access-bz2jw" (OuterVolumeSpecName: "kube-api-access-bz2jw") pod "ff411fff-0189-4cd1-bb06-d0780f3a3fdc" (UID: "ff411fff-0189-4cd1-bb06-d0780f3a3fdc"). InnerVolumeSpecName "kube-api-access-bz2jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:39:32.182725 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.182692    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz2jw\" (UniqueName: \"kubernetes.io/projected/ff411fff-0189-4cd1-bb06-d0780f3a3fdc-kube-api-access-bz2jw\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:32.799820 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.799776    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff411fff-0189-4cd1-bb06-d0780f3a3fdc" containerID="02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853" exitCode=0
Jul 07 11:39:32.800032 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.799834    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cp6mp"
Jul 07 11:39:32.800032 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.799870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cp6mp" event={"ID":"ff411fff-0189-4cd1-bb06-d0780f3a3fdc","Type":"ContainerDied","Data":"02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853"}
Jul 07 11:39:32.800032 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.799921    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cp6mp" event={"ID":"ff411fff-0189-4cd1-bb06-d0780f3a3fdc","Type":"ContainerDied","Data":"08b914707d50c91e020792596c9ee3869cb32a93d3f64ea5530ca7413bb9d159"}
Jul 07 11:39:32.800032 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.799942    2564 scope.go:117] "RemoveContainer" containerID="02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853"
Jul 07 11:39:32.809717 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.809691    2564 scope.go:117] "RemoveContainer" containerID="02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853"
Jul 07 11:39:32.809993 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:39:32.809977    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853\": container with ID starting with 02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853 not found: ID does not exist" containerID="02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853"
Jul 07 11:39:32.810043 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.810002    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853"} err="failed to get container status \"02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853\": rpc error: code = NotFound desc = could not find container \"02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853\": container with ID starting with 02e8df9620823c8d23f5f28520e3794d2267889dca34fdcf07f637155c6c0853 not found: ID does not exist"
Jul 07 11:39:32.821574 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.821541    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cp6mp"]
Jul 07 11:39:32.825837 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:32.825810    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-cp6mp"]
Jul 07 11:39:33.418923 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:33.418887    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff411fff-0189-4cd1-bb06-d0780f3a3fdc" path="/var/lib/kubelet/pods/ff411fff-0189-4cd1-bb06-d0780f3a3fdc/volumes"
Jul 07 11:39:40.551316 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:40.551277    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"]
Jul 07 11:39:40.551911 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:40.551489    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc" podUID="bf54ce51-0c40-44ec-972b-cab0d43e374f" containerName="limitador" containerID="cri-o://21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8" gracePeriod=30
Jul 07 11:39:40.552343 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:40.552272    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:41.103229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.103204    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:41.161619 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.161528    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf54ce51-0c40-44ec-972b-cab0d43e374f-config-file\") pod \"bf54ce51-0c40-44ec-972b-cab0d43e374f\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") "
Jul 07 11:39:41.161619 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.161575    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzxpj\" (UniqueName: \"kubernetes.io/projected/bf54ce51-0c40-44ec-972b-cab0d43e374f-kube-api-access-dzxpj\") pod \"bf54ce51-0c40-44ec-972b-cab0d43e374f\" (UID: \"bf54ce51-0c40-44ec-972b-cab0d43e374f\") "
Jul 07 11:39:41.161954 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.161924    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf54ce51-0c40-44ec-972b-cab0d43e374f-config-file" (OuterVolumeSpecName: "config-file") pod "bf54ce51-0c40-44ec-972b-cab0d43e374f" (UID: "bf54ce51-0c40-44ec-972b-cab0d43e374f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:39:41.163834 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.163805    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf54ce51-0c40-44ec-972b-cab0d43e374f-kube-api-access-dzxpj" (OuterVolumeSpecName: "kube-api-access-dzxpj") pod "bf54ce51-0c40-44ec-972b-cab0d43e374f" (UID: "bf54ce51-0c40-44ec-972b-cab0d43e374f"). InnerVolumeSpecName "kube-api-access-dzxpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:39:41.262597 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.262563    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf54ce51-0c40-44ec-972b-cab0d43e374f-config-file\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:41.262597 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.262594    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzxpj\" (UniqueName: \"kubernetes.io/projected/bf54ce51-0c40-44ec-972b-cab0d43e374f-kube-api-access-dzxpj\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:41.849590 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.849491    2564 generic.go:356] "Generic (PLEG): container finished" podID="bf54ce51-0c40-44ec-972b-cab0d43e374f" containerID="21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8" exitCode=0
Jul 07 11:39:41.849590 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.849540    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"
Jul 07 11:39:41.850160 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.849583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc" event={"ID":"bf54ce51-0c40-44ec-972b-cab0d43e374f","Type":"ContainerDied","Data":"21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8"}
Jul 07 11:39:41.850160 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.849661    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6jrkc" event={"ID":"bf54ce51-0c40-44ec-972b-cab0d43e374f","Type":"ContainerDied","Data":"610a0b87b74db8352018e0853bd1d16ed549f34d339bdc91c2d5f0d892578749"}
Jul 07 11:39:41.850160 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.849694    2564 scope.go:117] "RemoveContainer" containerID="21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8"
Jul 07 11:39:41.859012 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.858992    2564 scope.go:117] "RemoveContainer" containerID="21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8"
Jul 07 11:39:41.859321 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:39:41.859297    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8\": container with ID starting with 21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8 not found: ID does not exist" containerID="21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8"
Jul 07 11:39:41.859374 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.859331    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8"} err="failed to get container status \"21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8\": rpc error: code = NotFound desc = could not find container \"21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8\": container with ID starting with 21f0c29c21debd3e963bc220bb1568ef1f21b0ef4a853829eb2c9898826c45f8 not found: ID does not exist"
Jul 07 11:39:41.867141 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.867113    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"]
Jul 07 11:39:41.871078 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:41.871053    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6jrkc"]
Jul 07 11:39:43.418528 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:43.418488    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf54ce51-0c40-44ec-972b-cab0d43e374f" path="/var/lib/kubelet/pods/bf54ce51-0c40-44ec-972b-cab0d43e374f/volumes"
Jul 07 11:39:45.606527 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.606491    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-bm8vd"]
Jul 07 11:39:45.607020 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.607004    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf54ce51-0c40-44ec-972b-cab0d43e374f" containerName="limitador"
Jul 07 11:39:45.607086 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.607021    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf54ce51-0c40-44ec-972b-cab0d43e374f" containerName="limitador"
Jul 07 11:39:45.607086 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.607052    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff411fff-0189-4cd1-bb06-d0780f3a3fdc" containerName="authorino"
Jul 07 11:39:45.607086 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.607060    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff411fff-0189-4cd1-bb06-d0780f3a3fdc" containerName="authorino"
Jul 07 11:39:45.607242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.607141    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff411fff-0189-4cd1-bb06-d0780f3a3fdc" containerName="authorino"
Jul 07 11:39:45.607242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.607153    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf54ce51-0c40-44ec-972b-cab0d43e374f" containerName="limitador"
Jul 07 11:39:45.611920 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.611899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:45.614856 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.614832    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-84njh\""
Jul 07 11:39:45.615143 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.614929    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 11:39:45.618567 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.618505    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bm8vd"]
Jul 07 11:39:45.639938 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.639891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:45.706549 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.706513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87gfh\" (UniqueName: \"kubernetes.io/projected/1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6-kube-api-access-87gfh\") pod \"postgres-69fb4594cf-bm8vd\" (UID: \"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6\") " pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:45.706549 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.706553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6-data\") pod \"postgres-69fb4594cf-bm8vd\" (UID: \"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6\") " pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:45.807378 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.807340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87gfh\" (UniqueName: \"kubernetes.io/projected/1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6-kube-api-access-87gfh\") pod \"postgres-69fb4594cf-bm8vd\" (UID: \"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6\") " pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:45.807378 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.807377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6-data\") pod \"postgres-69fb4594cf-bm8vd\" (UID: \"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6\") " pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:45.807848 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.807829    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6-data\") pod \"postgres-69fb4594cf-bm8vd\" (UID: \"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6\") " pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:45.816956 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.816924    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87gfh\" (UniqueName: \"kubernetes.io/projected/1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6-kube-api-access-87gfh\") pod \"postgres-69fb4594cf-bm8vd\" (UID: \"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6\") " pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:45.924770 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:45.924736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:46.064611 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:46.064582    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bm8vd"]
Jul 07 11:39:46.066702 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:39:46.066674    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea10bb8_cdb6_4e45_b0a7_4eb78b40cfd6.slice/crio-e5766b5389f94eee62ecee443e824c3ab1945f7bde457c11b41dc12502485b1d WatchSource:0}: Error finding container e5766b5389f94eee62ecee443e824c3ab1945f7bde457c11b41dc12502485b1d: Status 404 returned error can't find the container with id e5766b5389f94eee62ecee443e824c3ab1945f7bde457c11b41dc12502485b1d
Jul 07 11:39:46.882360 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:46.882318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bm8vd" event={"ID":"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6","Type":"ContainerStarted","Data":"e5766b5389f94eee62ecee443e824c3ab1945f7bde457c11b41dc12502485b1d"}
Jul 07 11:39:51.914015 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:51.913977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bm8vd" event={"ID":"1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6","Type":"ContainerStarted","Data":"b2e58d8988863764e0cda3a5b584ff5f4c9acfff56320399d5a4c1d796b884fe"}
Jul 07 11:39:51.914496 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:51.914083    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:57.950130 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:57.950101    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-bm8vd"
Jul 07 11:39:57.967798 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:57.967749    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-bm8vd" podStartSLOduration=8.176503944 podStartE2EDuration="12.967733396s" totalImagesPullingTime="4.791229452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:39:51.950988518 +0000 UTC m=+774.990213215" watchObservedRunningTime="2026-07-07 11:39:57.967733396 +0000 UTC m=+781.006958096"
Jul 07 11:39:58.267781 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.267672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:58.495932 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.495900    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlpcn"]
Jul 07 11:39:58.502700 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.502672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlpcn"
Jul 07 11:39:58.504883 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.504856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlpcn"]
Jul 07 11:39:58.505717 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.505689    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qxgqn\""
Jul 07 11:39:58.562331 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.562258    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:39:58.627368 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.627330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfxv4\" (UniqueName: \"kubernetes.io/projected/b21034f5-da30-40fe-82a8-a10e1ef6f4d3-kube-api-access-vfxv4\") pod \"authorino-5d4b67c446-hlpcn\" (UID: \"b21034f5-da30-40fe-82a8-a10e1ef6f4d3\") " pod="kuadrant-system/authorino-5d4b67c446-hlpcn"
Jul 07 11:39:58.728394 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.728337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxv4\" (UniqueName: \"kubernetes.io/projected/b21034f5-da30-40fe-82a8-a10e1ef6f4d3-kube-api-access-vfxv4\") pod \"authorino-5d4b67c446-hlpcn\" (UID: \"b21034f5-da30-40fe-82a8-a10e1ef6f4d3\") " pod="kuadrant-system/authorino-5d4b67c446-hlpcn"
Jul 07 11:39:58.738929 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.738894    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlpcn"]
Jul 07 11:39:58.739240 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:39:58.739216    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vfxv4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-hlpcn" podUID="b21034f5-da30-40fe-82a8-a10e1ef6f4d3"
Jul 07 11:39:58.740184 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.740159    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfxv4\" (UniqueName: \"kubernetes.io/projected/b21034f5-da30-40fe-82a8-a10e1ef6f4d3-kube-api-access-vfxv4\") pod \"authorino-5d4b67c446-hlpcn\" (UID: \"b21034f5-da30-40fe-82a8-a10e1ef6f4d3\") " pod="kuadrant-system/authorino-5d4b67c446-hlpcn"
Jul 07 11:39:58.769575 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.769544    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74c894865b-986xr"]
Jul 07 11:39:58.773706 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.773674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74c894865b-986xr"
Jul 07 11:39:58.783469 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.783436    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74c894865b-986xr"]
Jul 07 11:39:58.802402 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.802366    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74c894865b-986xr"]
Jul 07 11:39:58.802675 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:39:58.802655    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rwnr7], unattached volumes=[], failed to process volumes=[kube-api-access-rwnr7]: context canceled" pod="kuadrant-system/authorino-74c894865b-986xr" podUID="f811a4f6-69eb-4b39-9847-8ad2d7a5febc"
Jul 07 11:39:58.830499 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.830428    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55bd6b5548-5mgjc"]
Jul 07 11:39:58.834257 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.834236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:58.837110 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.837091    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 11:39:58.841705 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.841683    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55bd6b5548-5mgjc"]
Jul 07 11:39:58.929390 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.929351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8639543-d0e9-4846-9bcc-d2a355ade464-tls-cert\") pod \"authorino-55bd6b5548-5mgjc\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") " pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:58.929561 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.929409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwnr7\" (UniqueName: \"kubernetes.io/projected/f811a4f6-69eb-4b39-9847-8ad2d7a5febc-kube-api-access-rwnr7\") pod \"authorino-74c894865b-986xr\" (UID: \"f811a4f6-69eb-4b39-9847-8ad2d7a5febc\") " pod="kuadrant-system/authorino-74c894865b-986xr"
Jul 07 11:39:58.929561 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.929437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkgdl\" (UniqueName: \"kubernetes.io/projected/e8639543-d0e9-4846-9bcc-d2a355ade464-kube-api-access-kkgdl\") pod \"authorino-55bd6b5548-5mgjc\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") " pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:58.948566 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.948535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74c894865b-986xr"
Jul 07 11:39:58.948765 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.948536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlpcn"
Jul 07 11:39:58.955778 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.955760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74c894865b-986xr"
Jul 07 11:39:58.958998 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:58.958981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlpcn"
Jul 07 11:39:59.030478 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.030442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8639543-d0e9-4846-9bcc-d2a355ade464-tls-cert\") pod \"authorino-55bd6b5548-5mgjc\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") " pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:59.030713 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.030510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwnr7\" (UniqueName: \"kubernetes.io/projected/f811a4f6-69eb-4b39-9847-8ad2d7a5febc-kube-api-access-rwnr7\") pod \"authorino-74c894865b-986xr\" (UID: \"f811a4f6-69eb-4b39-9847-8ad2d7a5febc\") " pod="kuadrant-system/authorino-74c894865b-986xr"
Jul 07 11:39:59.030713 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.030537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkgdl\" (UniqueName: \"kubernetes.io/projected/e8639543-d0e9-4846-9bcc-d2a355ade464-kube-api-access-kkgdl\") pod \"authorino-55bd6b5548-5mgjc\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") " pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:59.033135 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.033112    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8639543-d0e9-4846-9bcc-d2a355ade464-tls-cert\") pod \"authorino-55bd6b5548-5mgjc\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") " pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:59.039233 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.039203    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwnr7\" (UniqueName: \"kubernetes.io/projected/f811a4f6-69eb-4b39-9847-8ad2d7a5febc-kube-api-access-rwnr7\") pod \"authorino-74c894865b-986xr\" (UID: \"f811a4f6-69eb-4b39-9847-8ad2d7a5febc\") " pod="kuadrant-system/authorino-74c894865b-986xr"
Jul 07 11:39:59.039339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.039208    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkgdl\" (UniqueName: \"kubernetes.io/projected/e8639543-d0e9-4846-9bcc-d2a355ade464-kube-api-access-kkgdl\") pod \"authorino-55bd6b5548-5mgjc\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") " pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:59.131309 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.131221    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfxv4\" (UniqueName: \"kubernetes.io/projected/b21034f5-da30-40fe-82a8-a10e1ef6f4d3-kube-api-access-vfxv4\") pod \"b21034f5-da30-40fe-82a8-a10e1ef6f4d3\" (UID: \"b21034f5-da30-40fe-82a8-a10e1ef6f4d3\") "
Jul 07 11:39:59.131488 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.131322    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwnr7\" (UniqueName: \"kubernetes.io/projected/f811a4f6-69eb-4b39-9847-8ad2d7a5febc-kube-api-access-rwnr7\") pod \"f811a4f6-69eb-4b39-9847-8ad2d7a5febc\" (UID: \"f811a4f6-69eb-4b39-9847-8ad2d7a5febc\") "
Jul 07 11:39:59.133569 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.133541    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b21034f5-da30-40fe-82a8-a10e1ef6f4d3-kube-api-access-vfxv4" (OuterVolumeSpecName: "kube-api-access-vfxv4") pod "b21034f5-da30-40fe-82a8-a10e1ef6f4d3" (UID: "b21034f5-da30-40fe-82a8-a10e1ef6f4d3"). InnerVolumeSpecName "kube-api-access-vfxv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:39:59.133707 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.133578    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f811a4f6-69eb-4b39-9847-8ad2d7a5febc-kube-api-access-rwnr7" (OuterVolumeSpecName: "kube-api-access-rwnr7") pod "f811a4f6-69eb-4b39-9847-8ad2d7a5febc" (UID: "f811a4f6-69eb-4b39-9847-8ad2d7a5febc"). InnerVolumeSpecName "kube-api-access-rwnr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:39:59.143739 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.143717    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:39:59.232399 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.232368    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwnr7\" (UniqueName: \"kubernetes.io/projected/f811a4f6-69eb-4b39-9847-8ad2d7a5febc-kube-api-access-rwnr7\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:59.232399 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.232398    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfxv4\" (UniqueName: \"kubernetes.io/projected/b21034f5-da30-40fe-82a8-a10e1ef6f4d3-kube-api-access-vfxv4\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:39:59.290814 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.290787    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55bd6b5548-5mgjc"]
Jul 07 11:39:59.292381 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:39:59.292351    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8639543_d0e9_4846_9bcc_d2a355ade464.slice/crio-fca1be6d2e41a8becf728b927db9e4e8474a56c05929c91a2f8fe634eb88de97 WatchSource:0}: Error finding container fca1be6d2e41a8becf728b927db9e4e8474a56c05929c91a2f8fe634eb88de97: Status 404 returned error can't find the container with id fca1be6d2e41a8becf728b927db9e4e8474a56c05929c91a2f8fe634eb88de97
Jul 07 11:39:59.955562 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.955517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55bd6b5548-5mgjc" event={"ID":"e8639543-d0e9-4846-9bcc-d2a355ade464","Type":"ContainerStarted","Data":"5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18"}
Jul 07 11:39:59.955755 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.955572    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55bd6b5548-5mgjc" event={"ID":"e8639543-d0e9-4846-9bcc-d2a355ade464","Type":"ContainerStarted","Data":"fca1be6d2e41a8becf728b927db9e4e8474a56c05929c91a2f8fe634eb88de97"}
Jul 07 11:39:59.955755 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.955580    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hlpcn"
Jul 07 11:39:59.956173 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.955790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74c894865b-986xr"
Jul 07 11:39:59.974085 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:39:59.973990    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55bd6b5548-5mgjc" podStartSLOduration=1.557714012 podStartE2EDuration="1.973975042s" totalImagesPullingTime="416.26103ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:39:59.971951417 +0000 UTC m=+783.011176142" watchObservedRunningTime="2026-07-07 11:39:59.973975042 +0000 UTC m=+783.013199743"
Jul 07 11:40:00.000198 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:00.000161    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74c894865b-986xr"]
Jul 07 11:40:00.008139 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:00.008109    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74c894865b-986xr"]
Jul 07 11:40:00.029158 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:00.029129    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlpcn"]
Jul 07 11:40:00.034759 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:00.034726    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hlpcn"]
Jul 07 11:40:01.418657 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:01.418600    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b21034f5-da30-40fe-82a8-a10e1ef6f4d3" path="/var/lib/kubelet/pods/b21034f5-da30-40fe-82a8-a10e1ef6f4d3/volumes"
Jul 07 11:40:01.419141 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:01.418864    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f811a4f6-69eb-4b39-9847-8ad2d7a5febc" path="/var/lib/kubelet/pods/f811a4f6-69eb-4b39-9847-8ad2d7a5febc/volumes"
Jul 07 11:40:01.492065 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:01.492022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:01.544812 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:01.544774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:04.265697 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.265661    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-656f9c6cf4-ttq5s"]
Jul 07 11:40:04.268375 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.268339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:04.390449 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.390392    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:04.465527 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.465491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:04.481048 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.481014    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-656f9c6cf4-ttq5s"]
Jul 07 11:40:04.481236 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.481069    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ffd5b775c-nhlcd"]
Jul 07 11:40:04.481236 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.481078    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.483991 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.483959    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 11:40:04.485110 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.485082    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 11:40:04.485254 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.485176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-62fjh\""
Jul 07 11:40:04.505325 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.505290    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ffd5b775c-nhlcd"]
Jul 07 11:40:04.505496 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.505422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.528059 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.527969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:04.581706 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.581665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56d31c01-61cc-4b2d-9cba-0d43c53b6409-webhook-cert\") pod \"maas-controller-656f9c6cf4-ttq5s\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") " pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.581918 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.581764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rlh\" (UniqueName: \"kubernetes.io/projected/56d31c01-61cc-4b2d-9cba-0d43c53b6409-kube-api-access-k6rlh\") pod \"maas-controller-656f9c6cf4-ttq5s\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") " pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.682958 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.682908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rlh\" (UniqueName: \"kubernetes.io/projected/56d31c01-61cc-4b2d-9cba-0d43c53b6409-kube-api-access-k6rlh\") pod \"maas-controller-656f9c6cf4-ttq5s\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") " pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.683180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.682998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wk4v\" (UniqueName: \"kubernetes.io/projected/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-kube-api-access-4wk4v\") pod \"maas-controller-ffd5b775c-nhlcd\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") " pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.683180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.683067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-webhook-cert\") pod \"maas-controller-ffd5b775c-nhlcd\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") " pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.683180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.683100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56d31c01-61cc-4b2d-9cba-0d43c53b6409-webhook-cert\") pod \"maas-controller-656f9c6cf4-ttq5s\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") " pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.685662 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.685621    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56d31c01-61cc-4b2d-9cba-0d43c53b6409-webhook-cert\") pod \"maas-controller-656f9c6cf4-ttq5s\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") " pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.692681 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.692660    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rlh\" (UniqueName: \"kubernetes.io/projected/56d31c01-61cc-4b2d-9cba-0d43c53b6409-kube-api-access-k6rlh\") pod \"maas-controller-656f9c6cf4-ttq5s\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") " pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.784386 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.784296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wk4v\" (UniqueName: \"kubernetes.io/projected/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-kube-api-access-4wk4v\") pod \"maas-controller-ffd5b775c-nhlcd\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") " pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.784386 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.784359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-webhook-cert\") pod \"maas-controller-ffd5b775c-nhlcd\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") " pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.787089 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.787066    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-webhook-cert\") pod \"maas-controller-ffd5b775c-nhlcd\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") " pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.791855 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.791825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:04.794229 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.794203    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wk4v\" (UniqueName: \"kubernetes.io/projected/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-kube-api-access-4wk4v\") pod \"maas-controller-ffd5b775c-nhlcd\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") " pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.816170 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.816137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:04.973449 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.973424    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-656f9c6cf4-ttq5s"]
Jul 07 11:40:04.976575 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:40:04.976544    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d31c01_61cc_4b2d_9cba_0d43c53b6409.slice/crio-20d4f3650e9164ba1596210d9128b1cf3acb1fcf250a6fa416e81aa3abf35eed WatchSource:0}: Error finding container 20d4f3650e9164ba1596210d9128b1cf3acb1fcf250a6fa416e81aa3abf35eed: Status 404 returned error can't find the container with id 20d4f3650e9164ba1596210d9128b1cf3acb1fcf250a6fa416e81aa3abf35eed
Jul 07 11:40:04.997518 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:04.997369    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ffd5b775c-nhlcd"]
Jul 07 11:40:04.999849 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:40:04.999822    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1c6fc1_fb8d_4a6b_ad8f_3c32f236654a.slice/crio-3cd5c2e215a4c1e0bbcfd2905cb7e2b1c3db4b12a1417bbc22ea10a5593041ea WatchSource:0}: Error finding container 3cd5c2e215a4c1e0bbcfd2905cb7e2b1c3db4b12a1417bbc22ea10a5593041ea: Status 404 returned error can't find the container with id 3cd5c2e215a4c1e0bbcfd2905cb7e2b1c3db4b12a1417bbc22ea10a5593041ea
Jul 07 11:40:05.992583 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:05.992500    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s" event={"ID":"56d31c01-61cc-4b2d-9cba-0d43c53b6409","Type":"ContainerStarted","Data":"20d4f3650e9164ba1596210d9128b1cf3acb1fcf250a6fa416e81aa3abf35eed"}
Jul 07 11:40:05.995123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:05.995046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffd5b775c-nhlcd" event={"ID":"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a","Type":"ContainerStarted","Data":"3cd5c2e215a4c1e0bbcfd2905cb7e2b1c3db4b12a1417bbc22ea10a5593041ea"}
Jul 07 11:40:07.287534 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:07.287500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:07.379113 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:07.379011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:08.009193 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:08.009154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s" event={"ID":"56d31c01-61cc-4b2d-9cba-0d43c53b6409","Type":"ContainerStarted","Data":"2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef"}
Jul 07 11:40:08.009428 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:08.009312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:08.010755 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:08.010728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffd5b775c-nhlcd" event={"ID":"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a","Type":"ContainerStarted","Data":"7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7"}
Jul 07 11:40:08.010885 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:08.010843    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:08.029087 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:08.029035    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s" podStartSLOduration=1.9161637200000001 podStartE2EDuration="4.029019855s" totalImagesPullingTime="2.112856135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:08.027095383 +0000 UTC m=+791.066320090" watchObservedRunningTime="2026-07-07 11:40:08.029019855 +0000 UTC m=+791.068244554"
Jul 07 11:40:08.044332 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:08.044281    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ffd5b775c-nhlcd" podStartSLOduration=1.959817991 podStartE2EDuration="4.044269065s" totalImagesPullingTime="2.084451074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:08.043451222 +0000 UTC m=+791.082675922" watchObservedRunningTime="2026-07-07 11:40:08.044269065 +0000 UTC m=+791.083493827"
Jul 07 11:40:19.022851 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.022766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:19.023280 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.023098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:40:19.087735 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.087698    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-656f9c6cf4-ttq5s"]
Jul 07 11:40:19.087951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.087920    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s" podUID="56d31c01-61cc-4b2d-9cba-0d43c53b6409" containerName="manager" containerID="cri-o://2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef" gracePeriod=30
Jul 07 11:40:19.341898 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.341870    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:19.411973 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.411942    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56d31c01-61cc-4b2d-9cba-0d43c53b6409-webhook-cert\") pod \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") "
Jul 07 11:40:19.412188 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.412000    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6rlh\" (UniqueName: \"kubernetes.io/projected/56d31c01-61cc-4b2d-9cba-0d43c53b6409-kube-api-access-k6rlh\") pod \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\" (UID: \"56d31c01-61cc-4b2d-9cba-0d43c53b6409\") "
Jul 07 11:40:19.414337 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.414304    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d31c01-61cc-4b2d-9cba-0d43c53b6409-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "56d31c01-61cc-4b2d-9cba-0d43c53b6409" (UID: "56d31c01-61cc-4b2d-9cba-0d43c53b6409"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:40:19.414470 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.414344    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d31c01-61cc-4b2d-9cba-0d43c53b6409-kube-api-access-k6rlh" (OuterVolumeSpecName: "kube-api-access-k6rlh") pod "56d31c01-61cc-4b2d-9cba-0d43c53b6409" (UID: "56d31c01-61cc-4b2d-9cba-0d43c53b6409"). InnerVolumeSpecName "kube-api-access-k6rlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:40:19.513248 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.513204    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6rlh\" (UniqueName: \"kubernetes.io/projected/56d31c01-61cc-4b2d-9cba-0d43c53b6409-kube-api-access-k6rlh\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:40:19.513248 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:19.513240    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56d31c01-61cc-4b2d-9cba-0d43c53b6409-webhook-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:40:20.084260 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.084223    2564 generic.go:356] "Generic (PLEG): container finished" podID="56d31c01-61cc-4b2d-9cba-0d43c53b6409" containerID="2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef" exitCode=0
Jul 07 11:40:20.084260 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.084265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s" event={"ID":"56d31c01-61cc-4b2d-9cba-0d43c53b6409","Type":"ContainerDied","Data":"2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef"}
Jul 07 11:40:20.084776 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.084285    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s"
Jul 07 11:40:20.084776 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.084338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-656f9c6cf4-ttq5s" event={"ID":"56d31c01-61cc-4b2d-9cba-0d43c53b6409","Type":"ContainerDied","Data":"20d4f3650e9164ba1596210d9128b1cf3acb1fcf250a6fa416e81aa3abf35eed"}
Jul 07 11:40:20.084776 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.084360    2564 scope.go:117] "RemoveContainer" containerID="2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef"
Jul 07 11:40:20.093448 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.093312    2564 scope.go:117] "RemoveContainer" containerID="2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef"
Jul 07 11:40:20.093587 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:40:20.093566    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef\": container with ID starting with 2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef not found: ID does not exist" containerID="2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef"
Jul 07 11:40:20.093708 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.093598    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef"} err="failed to get container status \"2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef\": rpc error: code = NotFound desc = could not find container \"2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef\": container with ID starting with 2e2be661fe17dbc11d22d0091e4c929c1dcac6ed991d3a9f671f2c3ce3dd87ef not found: ID does not exist"
Jul 07 11:40:20.105682 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.105647    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-656f9c6cf4-ttq5s"]
Jul 07 11:40:20.110526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:20.110502    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-656f9c6cf4-ttq5s"]
Jul 07 11:40:21.418051 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:21.418018    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d31c01-61cc-4b2d-9cba-0d43c53b6409" path="/var/lib/kubelet/pods/56d31c01-61cc-4b2d-9cba-0d43c53b6409/volumes"
Jul 07 11:40:36.414489 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.414454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:36.853330 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.853294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:36.900495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.900464    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6cbb5657bc-qhrws"]
Jul 07 11:40:36.900912 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.900898    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d31c01-61cc-4b2d-9cba-0d43c53b6409" containerName="manager"
Jul 07 11:40:36.900965 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.900914    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d31c01-61cc-4b2d-9cba-0d43c53b6409" containerName="manager"
Jul 07 11:40:36.901000 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.900979    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d31c01-61cc-4b2d-9cba-0d43c53b6409" containerName="manager"
Jul 07 11:40:36.905264 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.905246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:36.909214 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.909190    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vld86\""
Jul 07 11:40:36.909335 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.909192    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 11:40:36.917700 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.917670    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cbb5657bc-qhrws"]
Jul 07 11:40:36.953979 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.953941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:36.972205 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.972169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-maas-api-tls\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:36.972390 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.972220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzkg\" (UniqueName: \"kubernetes.io/projected/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-kube-api-access-ndzkg\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:36.972390 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:36.972325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-openshift-service-ca\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.073306 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.073263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-openshift-service-ca\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.073510 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.073340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-maas-api-tls\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.073510 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.073372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzkg\" (UniqueName: \"kubernetes.io/projected/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-kube-api-access-ndzkg\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.074036 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.074010    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-openshift-service-ca\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.075980 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.075960    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-maas-api-tls\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.084952 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.084928    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzkg\" (UniqueName: \"kubernetes.io/projected/18adc6d1-8ed1-4ee7-948f-356b2d6d01b0-kube-api-access-ndzkg\") pod \"maas-api-6cbb5657bc-qhrws\" (UID: \"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0\") " pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.216259 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.216217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:37.362758 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.362720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:37.386789 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.386757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cbb5657bc-qhrws"]
Jul 07 11:40:37.390522 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:40:37.390491    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18adc6d1_8ed1_4ee7_948f_356b2d6d01b0.slice/crio-69b41bcb2f6fd15983329af0a219b0396e67e49215629261db3006d406d298ec WatchSource:0}: Error finding container 69b41bcb2f6fd15983329af0a219b0396e67e49215629261db3006d406d298ec: Status 404 returned error can't find the container with id 69b41bcb2f6fd15983329af0a219b0396e67e49215629261db3006d406d298ec
Jul 07 11:40:37.462918 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.462881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:37.481866 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.481779    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rtjxt"]
Jul 07 11:40:37.486732 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.486710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.489776 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.489754    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 11:40:37.497826 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.497794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rtjxt"]
Jul 07 11:40:37.505157 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.505124    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dz6lb"]
Jul 07 11:40:37.508890 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.508816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.511948 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.511911    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j6qwb\""
Jul 07 11:40:37.518002 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.517975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dz6lb"]
Jul 07 11:40:37.579658 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.579592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd8lr\" (UniqueName: \"kubernetes.io/projected/07f15135-9e8d-486b-825b-44cbc1357007-kube-api-access-hd8lr\") pod \"payload-pre-processing-7964457696-rtjxt\" (UID: \"07f15135-9e8d-486b-825b-44cbc1357007\") " pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.579842 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.579665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm2fv\" (UniqueName: \"kubernetes.io/projected/8670c32e-78d4-4669-8ddd-846c382c00bc-kube-api-access-dm2fv\") pod \"payload-processing-58f86c7798-dz6lb\" (UID: \"8670c32e-78d4-4669-8ddd-846c382c00bc\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.579842 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.579801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8670c32e-78d4-4669-8ddd-846c382c00bc-plugins-config-volume\") pod \"payload-processing-58f86c7798-dz6lb\" (UID: \"8670c32e-78d4-4669-8ddd-846c382c00bc\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.579966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.579855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07f15135-9e8d-486b-825b-44cbc1357007-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rtjxt\" (UID: \"07f15135-9e8d-486b-825b-44cbc1357007\") " pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.680951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.680911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm2fv\" (UniqueName: \"kubernetes.io/projected/8670c32e-78d4-4669-8ddd-846c382c00bc-kube-api-access-dm2fv\") pod \"payload-processing-58f86c7798-dz6lb\" (UID: \"8670c32e-78d4-4669-8ddd-846c382c00bc\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.681127 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.681040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8670c32e-78d4-4669-8ddd-846c382c00bc-plugins-config-volume\") pod \"payload-processing-58f86c7798-dz6lb\" (UID: \"8670c32e-78d4-4669-8ddd-846c382c00bc\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.681208 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.681147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07f15135-9e8d-486b-825b-44cbc1357007-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rtjxt\" (UID: \"07f15135-9e8d-486b-825b-44cbc1357007\") " pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.681479 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.681452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd8lr\" (UniqueName: \"kubernetes.io/projected/07f15135-9e8d-486b-825b-44cbc1357007-kube-api-access-hd8lr\") pod \"payload-pre-processing-7964457696-rtjxt\" (UID: \"07f15135-9e8d-486b-825b-44cbc1357007\") " pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.681971 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.681942    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07f15135-9e8d-486b-825b-44cbc1357007-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rtjxt\" (UID: \"07f15135-9e8d-486b-825b-44cbc1357007\") " pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.682083 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.682018    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8670c32e-78d4-4669-8ddd-846c382c00bc-plugins-config-volume\") pod \"payload-processing-58f86c7798-dz6lb\" (UID: \"8670c32e-78d4-4669-8ddd-846c382c00bc\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.694287 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.694258    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm2fv\" (UniqueName: \"kubernetes.io/projected/8670c32e-78d4-4669-8ddd-846c382c00bc-kube-api-access-dm2fv\") pod \"payload-processing-58f86c7798-dz6lb\" (UID: \"8670c32e-78d4-4669-8ddd-846c382c00bc\") " pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.694417 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.694300    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd8lr\" (UniqueName: \"kubernetes.io/projected/07f15135-9e8d-486b-825b-44cbc1357007-kube-api-access-hd8lr\") pod \"payload-pre-processing-7964457696-rtjxt\" (UID: \"07f15135-9e8d-486b-825b-44cbc1357007\") " pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.799071 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.798970    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:37.822374 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.822341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:37.957339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.957308    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rtjxt"]
Jul 07 11:40:37.958011 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:40:37.957982    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07f15135_9e8d_486b_825b_44cbc1357007.slice/crio-37b958d6f7492ef4baa48f88f0248d4dab073c0ae3916847964497ead7bdaedc WatchSource:0}: Error finding container 37b958d6f7492ef4baa48f88f0248d4dab073c0ae3916847964497ead7bdaedc: Status 404 returned error can't find the container with id 37b958d6f7492ef4baa48f88f0248d4dab073c0ae3916847964497ead7bdaedc
Jul 07 11:40:37.983753 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:37.983731    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dz6lb"]
Jul 07 11:40:37.985889 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:40:37.985862    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8670c32e_78d4_4669_8ddd_846c382c00bc.slice/crio-300fcde7f5d73d9e4da08f4cf30c041e4d31b88c7b7a3e1bb412327508a7f6db WatchSource:0}: Error finding container 300fcde7f5d73d9e4da08f4cf30c041e4d31b88c7b7a3e1bb412327508a7f6db: Status 404 returned error can't find the container with id 300fcde7f5d73d9e4da08f4cf30c041e4d31b88c7b7a3e1bb412327508a7f6db
Jul 07 11:40:38.185249 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:38.185200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dz6lb" event={"ID":"8670c32e-78d4-4669-8ddd-846c382c00bc","Type":"ContainerStarted","Data":"300fcde7f5d73d9e4da08f4cf30c041e4d31b88c7b7a3e1bb412327508a7f6db"}
Jul 07 11:40:38.186704 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:38.186608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt" event={"ID":"07f15135-9e8d-486b-825b-44cbc1357007","Type":"ContainerStarted","Data":"37b958d6f7492ef4baa48f88f0248d4dab073c0ae3916847964497ead7bdaedc"}
Jul 07 11:40:38.188515 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:38.188484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cbb5657bc-qhrws" event={"ID":"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0","Type":"ContainerStarted","Data":"69b41bcb2f6fd15983329af0a219b0396e67e49215629261db3006d406d298ec"}
Jul 07 11:40:38.280170 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:38.280120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:40.201661 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.201601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt" event={"ID":"07f15135-9e8d-486b-825b-44cbc1357007","Type":"ContainerStarted","Data":"9a0898132f7f257dc56218362bd72e168943de00c32c8e90d01817ae6e319b12"}
Jul 07 11:40:40.202121 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.201731    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:40:40.203492 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.203466    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cbb5657bc-qhrws" event={"ID":"18adc6d1-8ed1-4ee7-948f-356b2d6d01b0","Type":"ContainerStarted","Data":"b036413338913d70b06bd6920caacc99240ebccaa942cc44b57e21f9330918f8"}
Jul 07 11:40:40.203644 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.203519    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:40.205035 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.205014    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dz6lb" event={"ID":"8670c32e-78d4-4669-8ddd-846c382c00bc","Type":"ContainerStarted","Data":"ac33d9f8c3d2a79b0f697a78d3f4e7916171b72f69435f44065cc0296a45f51e"}
Jul 07 11:40:40.205122 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.205061    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:40.224880 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.224810    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt" podStartSLOduration=1.7846647770000001 podStartE2EDuration="3.224794496s" totalImagesPullingTime="1.440129719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:40.222880899 +0000 UTC m=+823.262105599" watchObservedRunningTime="2026-07-07 11:40:40.224794496 +0000 UTC m=+823.264019174"
Jul 07 11:40:40.241180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.241126    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6cbb5657bc-qhrws" podStartSLOduration=2.233363527 podStartE2EDuration="4.241111823s" totalImagesPullingTime="2.007748296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:40.239489776 +0000 UTC m=+823.278714478" watchObservedRunningTime="2026-07-07 11:40:40.241111823 +0000 UTC m=+823.280336523"
Jul 07 11:40:40.257408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:40.257352    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-dz6lb" podStartSLOduration=1.842263296 podStartE2EDuration="3.257335556s" totalImagesPullingTime="1.41507226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:40.255332169 +0000 UTC m=+823.294556894" watchObservedRunningTime="2026-07-07 11:40:40.257335556 +0000 UTC m=+823.296560294"
Jul 07 11:40:46.216325 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:46.216297    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6cbb5657bc-qhrws"
Jul 07 11:40:47.207086 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:47.206998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:47.303798 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:47.303753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:49.211057 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:49.211026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:49.312872 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:49.312834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:51.212803 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:51.212773    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-dz6lb"
Jul 07 11:40:51.213166 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:40:51.212864    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-rtjxt"
Jul 07 11:41:00.280740 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:00.280698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:41:03.622822 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.622768    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"]
Jul 07 11:41:03.627929 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.627903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.632526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.632444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9wjpf\""
Jul 07 11:41:03.632526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.632456    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 11:41:03.632526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.632470    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 11:41:03.632526 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.632444    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 11:41:03.645988 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.645963    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"]
Jul 07 11:41:03.708755 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.708718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.708927 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.708774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b2dx\" (UniqueName: \"kubernetes.io/projected/b2ac4281-d67c-40a7-88d7-9831584a75cd-kube-api-access-9b2dx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.708927 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.708844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ac4281-d67c-40a7-88d7-9831584a75cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.708927 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.708914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.709060 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.708952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.709060 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.708975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.736408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.736365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:41:03.809702 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.809625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.809886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.809717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.809886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.809752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.809886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.809779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b2dx\" (UniqueName: \"kubernetes.io/projected/b2ac4281-d67c-40a7-88d7-9831584a75cd-kube-api-access-9b2dx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.809886 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.809825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ac4281-d67c-40a7-88d7-9831584a75cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.810080 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.809905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.810080 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.810068    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.810180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.810097    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.810180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.810155    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.812354 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.812337    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ac4281-d67c-40a7-88d7-9831584a75cd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.812641 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.812611    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ac4281-d67c-40a7-88d7-9831584a75cd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.820022 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.819996    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b2dx\" (UniqueName: \"kubernetes.io/projected/b2ac4281-d67c-40a7-88d7-9831584a75cd-kube-api-access-9b2dx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2hnft\" (UID: \"b2ac4281-d67c-40a7-88d7-9831584a75cd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:03.938799 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:03.938765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:04.090428 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:04.090394    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"]
Jul 07 11:41:04.092609 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:41:04.092578    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ac4281_d67c_40a7_88d7_9831584a75cd.slice/crio-7be1d5c53258a3ec3a8fa4e172bdb9739bd4078812c7462d8a854f15547c7ed2 WatchSource:0}: Error finding container 7be1d5c53258a3ec3a8fa4e172bdb9739bd4078812c7462d8a854f15547c7ed2: Status 404 returned error can't find the container with id 7be1d5c53258a3ec3a8fa4e172bdb9739bd4078812c7462d8a854f15547c7ed2
Jul 07 11:41:04.336364 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:04.336284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft" event={"ID":"b2ac4281-d67c-40a7-88d7-9831584a75cd","Type":"ContainerStarted","Data":"7be1d5c53258a3ec3a8fa4e172bdb9739bd4078812c7462d8a854f15547c7ed2"}
Jul 07 11:41:06.349316 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:06.349275    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft" event={"ID":"b2ac4281-d67c-40a7-88d7-9831584a75cd","Type":"ContainerStarted","Data":"9b2c3e19cf20224ce0d48e73c4c4eff1b9b7e06a73ccaf9299da4f790bf77c3c"}
Jul 07 11:41:06.372360 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:06.372312    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft" podStartSLOduration=2.1687699719999998 podStartE2EDuration="3.372296421s" totalImagesPullingTime="1.203526449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:06.370043436 +0000 UTC m=+849.409268137" watchObservedRunningTime="2026-07-07 11:41:06.372296421 +0000 UTC m=+849.411521120"
Jul 07 11:41:13.939135 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:13.939105    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:13.939574 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:13.939165    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:13.951964 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:13.951935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:14.404757 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:14.404680    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2hnft"
Jul 07 11:41:20.552271 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:20.552236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:41:27.487326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:27.487286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:41:29.320180 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:29.320146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:41:36.467350 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:36.467297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:41:43.730035 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:43.729999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:41:57.400014 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:57.399923    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:41:57.403357 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:41:57.403333    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:42:50.367461 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.367420    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bd4b78985-rstz8"]
Jul 07 11:42:50.370558 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.370534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.379583 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.379533    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd4b78985-rstz8"]
Jul 07 11:42:50.508420 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.508377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a112f96d-5f20-4f6c-a26f-0268bfb4e273-tls-cert\") pod \"authorino-5bd4b78985-rstz8\" (UID: \"a112f96d-5f20-4f6c-a26f-0268bfb4e273\") " pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.508599 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.508578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98dm4\" (UniqueName: \"kubernetes.io/projected/a112f96d-5f20-4f6c-a26f-0268bfb4e273-kube-api-access-98dm4\") pod \"authorino-5bd4b78985-rstz8\" (UID: \"a112f96d-5f20-4f6c-a26f-0268bfb4e273\") " pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.609715 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.609669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98dm4\" (UniqueName: \"kubernetes.io/projected/a112f96d-5f20-4f6c-a26f-0268bfb4e273-kube-api-access-98dm4\") pod \"authorino-5bd4b78985-rstz8\" (UID: \"a112f96d-5f20-4f6c-a26f-0268bfb4e273\") " pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.609904 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.609730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a112f96d-5f20-4f6c-a26f-0268bfb4e273-tls-cert\") pod \"authorino-5bd4b78985-rstz8\" (UID: \"a112f96d-5f20-4f6c-a26f-0268bfb4e273\") " pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.612365 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.612343    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a112f96d-5f20-4f6c-a26f-0268bfb4e273-tls-cert\") pod \"authorino-5bd4b78985-rstz8\" (UID: \"a112f96d-5f20-4f6c-a26f-0268bfb4e273\") " pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.618892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.618840    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98dm4\" (UniqueName: \"kubernetes.io/projected/a112f96d-5f20-4f6c-a26f-0268bfb4e273-kube-api-access-98dm4\") pod \"authorino-5bd4b78985-rstz8\" (UID: \"a112f96d-5f20-4f6c-a26f-0268bfb4e273\") " pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.681490 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.681450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bd4b78985-rstz8"
Jul 07 11:42:50.810256 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.810219    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:42:50.837489 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.837461    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bd4b78985-rstz8"]
Jul 07 11:42:50.839427 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:42:50.839397    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda112f96d_5f20_4f6c_a26f_0268bfb4e273.slice/crio-b912b592b52edd08e0b6e434451ed848c329cee91240b39b2327dbf2a9a2fb24 WatchSource:0}: Error finding container b912b592b52edd08e0b6e434451ed848c329cee91240b39b2327dbf2a9a2fb24: Status 404 returned error can't find the container with id b912b592b52edd08e0b6e434451ed848c329cee91240b39b2327dbf2a9a2fb24
Jul 07 11:42:50.840907 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.840889    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:42:50.909603 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.909503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:42:50.928500 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:50.928471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd4b78985-rstz8" event={"ID":"a112f96d-5f20-4f6c-a26f-0268bfb4e273","Type":"ContainerStarted","Data":"b912b592b52edd08e0b6e434451ed848c329cee91240b39b2327dbf2a9a2fb24"}
Jul 07 11:42:51.975778 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:51.975743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:42:52.154464 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:52.154426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:42:52.944876 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:52.944828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bd4b78985-rstz8" event={"ID":"a112f96d-5f20-4f6c-a26f-0268bfb4e273","Type":"ContainerStarted","Data":"fc668c84bc1bee75eb2fbcdcec63e4460fea58a064a1633ed5b89fa769b09c19"}
Jul 07 11:42:52.965793 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:52.965739    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bd4b78985-rstz8" podStartSLOduration=1.892334404 podStartE2EDuration="2.9657173s" totalImagesPullingTime="1.073382896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:42:52.963150977 +0000 UTC m=+956.002375697" watchObservedRunningTime="2026-07-07 11:42:52.9657173 +0000 UTC m=+956.004942002"
Jul 07 11:42:53.000807 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.000771    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55bd6b5548-5mgjc"]
Jul 07 11:42:53.001298 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.000989    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-55bd6b5548-5mgjc" podUID="e8639543-d0e9-4846-9bcc-d2a355ade464" containerName="authorino" containerID="cri-o://5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18" gracePeriod=30
Jul 07 11:42:53.294739 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.294712    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:42:53.437594 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.437564    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8639543-d0e9-4846-9bcc-d2a355ade464-tls-cert\") pod \"e8639543-d0e9-4846-9bcc-d2a355ade464\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") "
Jul 07 11:42:53.437779 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.437615    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkgdl\" (UniqueName: \"kubernetes.io/projected/e8639543-d0e9-4846-9bcc-d2a355ade464-kube-api-access-kkgdl\") pod \"e8639543-d0e9-4846-9bcc-d2a355ade464\" (UID: \"e8639543-d0e9-4846-9bcc-d2a355ade464\") "
Jul 07 11:42:53.440240 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.440196    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8639543-d0e9-4846-9bcc-d2a355ade464-kube-api-access-kkgdl" (OuterVolumeSpecName: "kube-api-access-kkgdl") pod "e8639543-d0e9-4846-9bcc-d2a355ade464" (UID: "e8639543-d0e9-4846-9bcc-d2a355ade464"). InnerVolumeSpecName "kube-api-access-kkgdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:42:53.452566 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.452525    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8639543-d0e9-4846-9bcc-d2a355ade464-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e8639543-d0e9-4846-9bcc-d2a355ade464" (UID: "e8639543-d0e9-4846-9bcc-d2a355ade464"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:53.538420 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.538336    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8639543-d0e9-4846-9bcc-d2a355ade464-tls-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:42:53.538420 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.538368    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkgdl\" (UniqueName: \"kubernetes.io/projected/e8639543-d0e9-4846-9bcc-d2a355ade464-kube-api-access-kkgdl\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:42:53.951515 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.951473    2564 generic.go:356] "Generic (PLEG): container finished" podID="e8639543-d0e9-4846-9bcc-d2a355ade464" containerID="5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18" exitCode=0
Jul 07 11:42:53.952189 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.952150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55bd6b5548-5mgjc" event={"ID":"e8639543-d0e9-4846-9bcc-d2a355ade464","Type":"ContainerDied","Data":"5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18"}
Jul 07 11:42:53.952189 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.952183    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bd6b5548-5mgjc"
Jul 07 11:42:53.952402 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.952206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55bd6b5548-5mgjc" event={"ID":"e8639543-d0e9-4846-9bcc-d2a355ade464","Type":"ContainerDied","Data":"fca1be6d2e41a8becf728b927db9e4e8474a56c05929c91a2f8fe634eb88de97"}
Jul 07 11:42:53.952402 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.952231    2564 scope.go:117] "RemoveContainer" containerID="5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18"
Jul 07 11:42:53.963902 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.963879    2564 scope.go:117] "RemoveContainer" containerID="5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18"
Jul 07 11:42:53.964256 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:42:53.964226    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18\": container with ID starting with 5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18 not found: ID does not exist" containerID="5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18"
Jul 07 11:42:53.964361 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.964265    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18"} err="failed to get container status \"5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18\": rpc error: code = NotFound desc = could not find container \"5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18\": container with ID starting with 5b77a91b562cce29a490dc6174dfb6a3a38a978c702a5b2828c67e40e7084f18 not found: ID does not exist"
Jul 07 11:42:53.979718 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.979680    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55bd6b5548-5mgjc"]
Jul 07 11:42:53.985617 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:53.985578    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55bd6b5548-5mgjc"]
Jul 07 11:42:55.419525 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:42:55.419488    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8639543-d0e9-4846-9bcc-d2a355ade464" path="/var/lib/kubelet/pods/e8639543-d0e9-4846-9bcc-d2a355ade464/volumes"
Jul 07 11:44:03.497322 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.497273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:03.596940 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.596901    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ffd5b775c-nhlcd"]
Jul 07 11:44:03.597208 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.597131    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-ffd5b775c-nhlcd" podUID="cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" containerName="manager" containerID="cri-o://7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7" gracePeriod=30
Jul 07 11:44:03.849141 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.849115    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:44:03.888740 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.888703    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wk4v\" (UniqueName: \"kubernetes.io/projected/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-kube-api-access-4wk4v\") pod \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") "
Jul 07 11:44:03.888948 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.888751    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-webhook-cert\") pod \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\" (UID: \"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a\") "
Jul 07 11:44:03.891056 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.891023    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-kube-api-access-4wk4v" (OuterVolumeSpecName: "kube-api-access-4wk4v") pod "cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" (UID: "cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a"). InnerVolumeSpecName "kube-api-access-4wk4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:44:03.891192 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.891056    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" (UID: "cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:44:03.989516 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.989474    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wk4v\" (UniqueName: \"kubernetes.io/projected/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-kube-api-access-4wk4v\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:44:03.989516 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:03.989510    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a-webhook-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:44:04.353397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.353363    2564 generic.go:356] "Generic (PLEG): container finished" podID="cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" containerID="7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7" exitCode=0
Jul 07 11:44:04.353397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.353403    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffd5b775c-nhlcd"
Jul 07 11:44:04.353623 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.353452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffd5b775c-nhlcd" event={"ID":"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a","Type":"ContainerDied","Data":"7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7"}
Jul 07 11:44:04.353623 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.353499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffd5b775c-nhlcd" event={"ID":"cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a","Type":"ContainerDied","Data":"3cd5c2e215a4c1e0bbcfd2905cb7e2b1c3db4b12a1417bbc22ea10a5593041ea"}
Jul 07 11:44:04.353623 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.353525    2564 scope.go:117] "RemoveContainer" containerID="7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7"
Jul 07 11:44:04.363671 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.363619    2564 scope.go:117] "RemoveContainer" containerID="7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7"
Jul 07 11:44:04.364001 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:44:04.363982    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7\": container with ID starting with 7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7 not found: ID does not exist" containerID="7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7"
Jul 07 11:44:04.364055 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.364012    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7"} err="failed to get container status \"7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7\": rpc error: code = NotFound desc = could not find container \"7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7\": container with ID starting with 7a3baf7cb3e90ab6aff527e3647aed9eaa14268fc88ebc1427eb76bc3d1250b7 not found: ID does not exist"
Jul 07 11:44:04.376308 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.376268    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ffd5b775c-nhlcd"]
Jul 07 11:44:04.380495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:04.380466    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ffd5b775c-nhlcd"]
Jul 07 11:44:05.053285 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.053242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:05.163496 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.163455    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ffd5b775c-pxx6n"]
Jul 07 11:44:05.163937 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.163924    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8639543-d0e9-4846-9bcc-d2a355ade464" containerName="authorino"
Jul 07 11:44:05.163999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.163938    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8639543-d0e9-4846-9bcc-d2a355ade464" containerName="authorino"
Jul 07 11:44:05.163999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.163953    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" containerName="manager"
Jul 07 11:44:05.163999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.163959    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" containerName="manager"
Jul 07 11:44:05.164113 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.164024    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8639543-d0e9-4846-9bcc-d2a355ade464" containerName="authorino"
Jul 07 11:44:05.164113 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.164036    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" containerName="manager"
Jul 07 11:44:05.166696 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.166677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.170774 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.170734    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 11:44:05.170901 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.170735    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-62fjh\""
Jul 07 11:44:05.170901 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.170734    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 11:44:05.175817 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.175789    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ffd5b775c-pxx6n"]
Jul 07 11:44:05.199034 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.198999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1562dfa9-ef2e-4421-9e72-a82504a83dcd-webhook-cert\") pod \"maas-controller-ffd5b775c-pxx6n\" (UID: \"1562dfa9-ef2e-4421-9e72-a82504a83dcd\") " pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.199205 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.199056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qzp\" (UniqueName: \"kubernetes.io/projected/1562dfa9-ef2e-4421-9e72-a82504a83dcd-kube-api-access-t5qzp\") pod \"maas-controller-ffd5b775c-pxx6n\" (UID: \"1562dfa9-ef2e-4421-9e72-a82504a83dcd\") " pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.300012 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.299972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qzp\" (UniqueName: \"kubernetes.io/projected/1562dfa9-ef2e-4421-9e72-a82504a83dcd-kube-api-access-t5qzp\") pod \"maas-controller-ffd5b775c-pxx6n\" (UID: \"1562dfa9-ef2e-4421-9e72-a82504a83dcd\") " pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.300188 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.300093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1562dfa9-ef2e-4421-9e72-a82504a83dcd-webhook-cert\") pod \"maas-controller-ffd5b775c-pxx6n\" (UID: \"1562dfa9-ef2e-4421-9e72-a82504a83dcd\") " pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.302686 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.302655    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1562dfa9-ef2e-4421-9e72-a82504a83dcd-webhook-cert\") pod \"maas-controller-ffd5b775c-pxx6n\" (UID: \"1562dfa9-ef2e-4421-9e72-a82504a83dcd\") " pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.309148 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.309076    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qzp\" (UniqueName: \"kubernetes.io/projected/1562dfa9-ef2e-4421-9e72-a82504a83dcd-kube-api-access-t5qzp\") pod \"maas-controller-ffd5b775c-pxx6n\" (UID: \"1562dfa9-ef2e-4421-9e72-a82504a83dcd\") " pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.419408 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.419371    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a" path="/var/lib/kubelet/pods/cf1c6fc1-fb8d-4a6b-ad8f-3c32f236654a/volumes"
Jul 07 11:44:05.478832 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.478794    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:05.620267 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:05.620237    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ffd5b775c-pxx6n"]
Jul 07 11:44:05.622304 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:44:05.622274    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1562dfa9_ef2e_4421_9e72_a82504a83dcd.slice/crio-b99f23a31ba54f51b0b5dc4663e6e26fa67599442c4812f4e3f745eb0870297b WatchSource:0}: Error finding container b99f23a31ba54f51b0b5dc4663e6e26fa67599442c4812f4e3f745eb0870297b: Status 404 returned error can't find the container with id b99f23a31ba54f51b0b5dc4663e6e26fa67599442c4812f4e3f745eb0870297b
Jul 07 11:44:06.366978 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:06.366869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffd5b775c-pxx6n" event={"ID":"1562dfa9-ef2e-4421-9e72-a82504a83dcd","Type":"ContainerStarted","Data":"8fa21a08265afb0fa23885ddd0b7781699e01f42b9b3a2ae57e84880bd0d660f"}
Jul 07 11:44:06.366978 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:06.366920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ffd5b775c-pxx6n" event={"ID":"1562dfa9-ef2e-4421-9e72-a82504a83dcd","Type":"ContainerStarted","Data":"b99f23a31ba54f51b0b5dc4663e6e26fa67599442c4812f4e3f745eb0870297b"}
Jul 07 11:44:06.367411 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:06.367009    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:06.386458 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:06.386407    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ffd5b775c-pxx6n" podStartSLOduration=0.897949362 podStartE2EDuration="1.38638891s" totalImagesPullingTime="488.439548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:44:06.383888494 +0000 UTC m=+1029.423113216" watchObservedRunningTime="2026-07-07 11:44:06.38638891 +0000 UTC m=+1029.425613610"
Jul 07 11:44:17.379835 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:17.379804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ffd5b775c-pxx6n"
Jul 07 11:44:30.421362 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:30.421318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:30.514599 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:30.514550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:43.647109 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:43.647072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:45.711467 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:45.711428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:45.809587 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:45.809550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:45.922297 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:45.922260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:51.992057 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:51.991968    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:52.053199 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:52.053153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:52.167322 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:52.167283    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:52.264770 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:52.264679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:52.364282 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:52.364233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:58.035766 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:58.035720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:44:58.094599 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:44:58.094562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:45:00.146559 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.146517    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723745-tv9xx"]
Jul 07 11:45:00.149739 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.149722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx"
Jul 07 11:45:00.159861 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.159832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723745-tv9xx"]
Jul 07 11:45:00.207155 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.207119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk4hj\" (UniqueName: \"kubernetes.io/projected/f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee-kube-api-access-wk4hj\") pod \"maas-api-key-cleanup-29723745-tv9xx\" (UID: \"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee\") " pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx"
Jul 07 11:45:00.308595 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.308552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk4hj\" (UniqueName: \"kubernetes.io/projected/f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee-kube-api-access-wk4hj\") pod \"maas-api-key-cleanup-29723745-tv9xx\" (UID: \"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee\") " pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx"
Jul 07 11:45:00.320443 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.320411    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk4hj\" (UniqueName: \"kubernetes.io/projected/f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee-kube-api-access-wk4hj\") pod \"maas-api-key-cleanup-29723745-tv9xx\" (UID: \"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee\") " pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx"
Jul 07 11:45:00.460679 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.460620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx"
Jul 07 11:45:00.616259 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.616233    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723745-tv9xx"]
Jul 07 11:45:00.618871 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:45:00.618839    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8aebdd6_c157_4f64_8fd8_fba2c4fef3ee.slice/crio-6c540225525312a67c979c293d0c1c3c6c2ea4a8f53961ed17c27a7efa228a97 WatchSource:0}: Error finding container 6c540225525312a67c979c293d0c1c3c6c2ea4a8f53961ed17c27a7efa228a97: Status 404 returned error can't find the container with id 6c540225525312a67c979c293d0c1c3c6c2ea4a8f53961ed17c27a7efa228a97
Jul 07 11:45:00.673008 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:00.672966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx" event={"ID":"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee","Type":"ContainerStarted","Data":"6c540225525312a67c979c293d0c1c3c6c2ea4a8f53961ed17c27a7efa228a97"}
Jul 07 11:45:03.700440 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:03.700396    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx" event={"ID":"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee","Type":"ContainerStarted","Data":"462be5a9baa0bd2f83b08877427bd41fe90fc809b32b6694963ba9553ba962ab"}
Jul 07 11:45:03.719549 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:03.719496    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx" podStartSLOduration=1.360394609 podStartE2EDuration="3.719481825s" totalImagesPullingTime="2.359087216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:45:03.717375222 +0000 UTC m=+1086.756599951" watchObservedRunningTime="2026-07-07 11:45:03.719481825 +0000 UTC m=+1086.758706525"
Jul 07 11:45:04.708522 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:04.708482    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee" containerID="462be5a9baa0bd2f83b08877427bd41fe90fc809b32b6694963ba9553ba962ab" exitCode=0
Jul 07 11:45:04.708923 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:04.708577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx" event={"ID":"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee","Type":"ContainerDied","Data":"462be5a9baa0bd2f83b08877427bd41fe90fc809b32b6694963ba9553ba962ab"}
Jul 07 11:45:05.855242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:05.855210    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx"
Jul 07 11:45:05.960566 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:05.960526    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk4hj\" (UniqueName: \"kubernetes.io/projected/f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee-kube-api-access-wk4hj\") pod \"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee\" (UID: \"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee\") "
Jul 07 11:45:05.962807 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:05.962779    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee-kube-api-access-wk4hj" (OuterVolumeSpecName: "kube-api-access-wk4hj") pod "f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee" (UID: "f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee"). InnerVolumeSpecName "kube-api-access-wk4hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:45:06.061917 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:06.061863    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk4hj\" (UniqueName: \"kubernetes.io/projected/f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee-kube-api-access-wk4hj\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:45:06.720163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:06.720128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx" event={"ID":"f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee","Type":"ContainerDied","Data":"6c540225525312a67c979c293d0c1c3c6c2ea4a8f53961ed17c27a7efa228a97"}
Jul 07 11:45:06.720163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:06.720166    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723745-tv9xx"
Jul 07 11:45:06.720397 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:06.720180    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c540225525312a67c979c293d0c1c3c6c2ea4a8f53961ed17c27a7efa228a97"
Jul 07 11:45:42.446766 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:42.446621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:45:42.524493 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:45:42.524449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:46:57.445528 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:46:57.445501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:46:57.448123 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:46:57.448102    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:47:44.712066 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:47:44.712005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:47:46.239871 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:47:46.239826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:47:55.383732 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:47:55.383653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:48:53.171246 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:53.171210    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"]
Jul 07 11:48:53.171808 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:53.171426    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv" podUID="5c19c565-652f-4b8a-9c01-5ca5834cb215" containerName="manager" containerID="cri-o://21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d" gracePeriod=10
Jul 07 11:48:55.926758 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:55.926733    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:48:55.998966 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:55.998937    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c19c565-652f-4b8a-9c01-5ca5834cb215" containerID="21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d" exitCode=0
Jul 07 11:48:55.999136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:55.998990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv" event={"ID":"5c19c565-652f-4b8a-9c01-5ca5834cb215","Type":"ContainerDied","Data":"21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d"}
Jul 07 11:48:55.999136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:55.998994    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"
Jul 07 11:48:55.999136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:55.999032    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv" event={"ID":"5c19c565-652f-4b8a-9c01-5ca5834cb215","Type":"ContainerDied","Data":"82fdb19dadd017aaf5ba6e2826e5dbea2332103591792c0447be517d42616495"}
Jul 07 11:48:55.999136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:55.999054    2564 scope.go:117] "RemoveContainer" containerID="21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d"
Jul 07 11:48:56.009053 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.009034    2564 scope.go:117] "RemoveContainer" containerID="21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d"
Jul 07 11:48:56.009352 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:48:56.009330    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d\": container with ID starting with 21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d not found: ID does not exist" containerID="21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d"
Jul 07 11:48:56.009430 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.009361    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d"} err="failed to get container status \"21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d\": rpc error: code = NotFound desc = could not find container \"21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d\": container with ID starting with 21b8f7f4b3d2de65cafcf8f013b36276ad9cbfb93d3002d85b629d7798715d7d not found: ID does not exist"
Jul 07 11:48:56.027830 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.027751    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd5gh\" (UniqueName: \"kubernetes.io/projected/5c19c565-652f-4b8a-9c01-5ca5834cb215-kube-api-access-nd5gh\") pod \"5c19c565-652f-4b8a-9c01-5ca5834cb215\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") "
Jul 07 11:48:56.027969 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.027833    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19c565-652f-4b8a-9c01-5ca5834cb215-extensions-socket-volume\") pod \"5c19c565-652f-4b8a-9c01-5ca5834cb215\" (UID: \"5c19c565-652f-4b8a-9c01-5ca5834cb215\") "
Jul 07 11:48:56.028244 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.028205    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c19c565-652f-4b8a-9c01-5ca5834cb215-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c19c565-652f-4b8a-9c01-5ca5834cb215" (UID: "5c19c565-652f-4b8a-9c01-5ca5834cb215"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:48:56.030065 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.030035    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c19c565-652f-4b8a-9c01-5ca5834cb215-kube-api-access-nd5gh" (OuterVolumeSpecName: "kube-api-access-nd5gh") pod "5c19c565-652f-4b8a-9c01-5ca5834cb215" (UID: "5c19c565-652f-4b8a-9c01-5ca5834cb215"). InnerVolumeSpecName "kube-api-access-nd5gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:48:56.128550 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.128510    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd5gh\" (UniqueName: \"kubernetes.io/projected/5c19c565-652f-4b8a-9c01-5ca5834cb215-kube-api-access-nd5gh\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:48:56.128550 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.128543    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c19c565-652f-4b8a-9c01-5ca5834cb215-extensions-socket-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:48:56.323690 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.323652    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"]
Jul 07 11:48:56.327763 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:56.327739    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d9qbv"]
Jul 07 11:48:57.419617 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:48:57.419581    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c19c565-652f-4b8a-9c01-5ca5834cb215" path="/var/lib/kubelet/pods/5c19c565-652f-4b8a-9c01-5ca5834cb215/volumes"
Jul 07 11:49:27.378754 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:27.378723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:49:27.435563 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:27.435523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:49:54.320970 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.320933    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"]
Jul 07 11:49:54.321395 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.321383    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee" containerName="cleanup"
Jul 07 11:49:54.321439 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.321396    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee" containerName="cleanup"
Jul 07 11:49:54.321439 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.321408    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c19c565-652f-4b8a-9c01-5ca5834cb215" containerName="manager"
Jul 07 11:49:54.321439 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.321413    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c19c565-652f-4b8a-9c01-5ca5834cb215" containerName="manager"
Jul 07 11:49:54.321527 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.321489    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee" containerName="cleanup"
Jul 07 11:49:54.321527 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.321499    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c19c565-652f-4b8a-9c01-5ca5834cb215" containerName="manager"
Jul 07 11:49:54.324605 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.324590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.331284 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.331147    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qcgf6\""
Jul 07 11:49:54.338046 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.338021    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"]
Jul 07 11:49:54.464747 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.464708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de31ed77-ddec-4555-a5a4-1a6815ffb465-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7n6dc\" (UID: \"de31ed77-ddec-4555-a5a4-1a6815ffb465\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.464747 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.464752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnppb\" (UniqueName: \"kubernetes.io/projected/de31ed77-ddec-4555-a5a4-1a6815ffb465-kube-api-access-gnppb\") pod \"kuadrant-operator-controller-manager-86878c769f-7n6dc\" (UID: \"de31ed77-ddec-4555-a5a4-1a6815ffb465\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.566164 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.566116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de31ed77-ddec-4555-a5a4-1a6815ffb465-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7n6dc\" (UID: \"de31ed77-ddec-4555-a5a4-1a6815ffb465\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.566338 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.566205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnppb\" (UniqueName: \"kubernetes.io/projected/de31ed77-ddec-4555-a5a4-1a6815ffb465-kube-api-access-gnppb\") pod \"kuadrant-operator-controller-manager-86878c769f-7n6dc\" (UID: \"de31ed77-ddec-4555-a5a4-1a6815ffb465\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.566473 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.566456    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de31ed77-ddec-4555-a5a4-1a6815ffb465-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7n6dc\" (UID: \"de31ed77-ddec-4555-a5a4-1a6815ffb465\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.575456 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.575391    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnppb\" (UniqueName: \"kubernetes.io/projected/de31ed77-ddec-4555-a5a4-1a6815ffb465-kube-api-access-gnppb\") pod \"kuadrant-operator-controller-manager-86878c769f-7n6dc\" (UID: \"de31ed77-ddec-4555-a5a4-1a6815ffb465\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.635365 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.635320    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:54.780570 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:54.780543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"]
Jul 07 11:49:54.782938 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:49:54.782906    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde31ed77_ddec_4555_a5a4_1a6815ffb465.slice/crio-0b489a4e0e50f65f73f1ac9255bbc1028aec8960976318356a9b9728dae2941b WatchSource:0}: Error finding container 0b489a4e0e50f65f73f1ac9255bbc1028aec8960976318356a9b9728dae2941b: Status 404 returned error can't find the container with id 0b489a4e0e50f65f73f1ac9255bbc1028aec8960976318356a9b9728dae2941b
Jul 07 11:49:55.309290 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:55.309253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc" event={"ID":"de31ed77-ddec-4555-a5a4-1a6815ffb465","Type":"ContainerStarted","Data":"1c813aebddda683ba68e53925a2b8026695f0bf16a6f1356020e1097fc2e06cb"}
Jul 07 11:49:55.309621 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:55.309306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc" event={"ID":"de31ed77-ddec-4555-a5a4-1a6815ffb465","Type":"ContainerStarted","Data":"0b489a4e0e50f65f73f1ac9255bbc1028aec8960976318356a9b9728dae2941b"}
Jul 07 11:49:55.309621 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:55.309333    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:49:55.330054 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:49:55.329922    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc" podStartSLOduration=1.329904551 podStartE2EDuration="1.329904551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:49:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:49:55.328343516 +0000 UTC m=+1378.367568229" watchObservedRunningTime="2026-07-07 11:49:55.329904551 +0000 UTC m=+1378.369129249"
Jul 07 11:50:06.317325 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:50:06.317294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n6dc"
Jul 07 11:51:57.480483 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:51:57.480453    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:51:57.489660 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:51:57.489625    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:52:05.866307 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:52:05.866271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:37.635252 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:37.635217    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:42.224794 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:42.224761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:42.323578 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:42.323546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:42.934224 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:42.934194    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:51.161840 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:51.161793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:56.263052 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:56.262995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:59.103111 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:59.103070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:59.210449 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:59.210407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:55:59.501111 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:55:59.501072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:06.026374 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:06.026344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:06.129225 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:06.129193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:06.253606 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:06.253565    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:06.349208 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:06.349129    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:07.428553 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.428510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:07.506241 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.506205    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"]
Jul 07 11:56:07.509604 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.509579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.512298 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.512271    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-044dd768-serving-cert\""
Jul 07 11:56:07.512884 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.512860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:07.520667 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.520613    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"]
Jul 07 11:56:07.609161 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.609128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:07.633543 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.633501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9st47\" (UniqueName: \"kubernetes.io/projected/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-kube-api-access-9st47\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.633543 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.633544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-openshift-service-ca\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.633783 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.633579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-maas-api-tls\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.732838 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.732743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:07.734933 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.734907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9st47\" (UniqueName: \"kubernetes.io/projected/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-kube-api-access-9st47\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.735043 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.734944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-openshift-service-ca\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.735043 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.734986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-maas-api-tls\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.735706 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.735651    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-openshift-service-ca\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.737413 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.737385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-maas-api-tls\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.748576 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.748549    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9st47\" (UniqueName: \"kubernetes.io/projected/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-kube-api-access-9st47\") pod \"maas-api-e2e-ait-044dd768-84f5d6796c-th7b5\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") " pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:07.821104 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:07.821073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:08.166001 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:08.165910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:08.183141 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:08.183113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"]
Jul 07 11:56:08.185133 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:56:08.185102    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf2f5f4_52a5_42d2_b5a7_eafefe61f0cb.slice/crio-70c035d31465a8fdc81dbca5b582dc9588bb21a2cda7c58542bc1fad83f6e408 WatchSource:0}: Error finding container 70c035d31465a8fdc81dbca5b582dc9588bb21a2cda7c58542bc1fad83f6e408: Status 404 returned error can't find the container with id 70c035d31465a8fdc81dbca5b582dc9588bb21a2cda7c58542bc1fad83f6e408
Jul 07 11:56:08.186495 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:08.186475    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:56:08.250362 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:08.250330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:08.381808 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:08.381766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5" event={"ID":"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb","Type":"ContainerStarted","Data":"70c035d31465a8fdc81dbca5b582dc9588bb21a2cda7c58542bc1fad83f6e408"}
Jul 07 11:56:09.388913 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:09.388872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5" event={"ID":"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb","Type":"ContainerStarted","Data":"16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65"}
Jul 07 11:56:09.389266 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:09.388947    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:09.407294 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:09.407223    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5" podStartSLOduration=1.9394520929999999 podStartE2EDuration="2.407204145s" totalImagesPullingTime="467.752052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:56:09.405439902 +0000 UTC m=+1752.444664634" watchObservedRunningTime="2026-07-07 11:56:09.407204145 +0000 UTC m=+1752.446428845"
Jul 07 11:56:10.089958 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:10.089922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:12.456258 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:12.456203    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:12.662986 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:12.662951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:12.761895 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:12.761796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:12.796798 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:12.796759    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"]
Jul 07 11:56:12.797039 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:12.797010    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5" podUID="cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" containerName="maas-api" containerID="cri-o://16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65" gracePeriod=30
Jul 07 11:56:12.850701 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:12.850661    2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf2f5f4_52a5_42d2_b5a7_eafefe61f0cb.slice/crio-conmon-16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65.scope\": RecentStats: unable to find data in memory cache]"
Jul 07 11:56:12.861892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:12.861858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:13.055781 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.055750    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:13.181069 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.181027    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-maas-api-tls\") pod \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") "
Jul 07 11:56:13.181253 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.181082    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-openshift-service-ca\") pod \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") "
Jul 07 11:56:13.181253 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.181120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9st47\" (UniqueName: \"kubernetes.io/projected/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-kube-api-access-9st47\") pod \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\" (UID: \"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb\") "
Jul 07 11:56:13.181459 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.181435    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" (UID: "cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:56:13.183228 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.183202    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" (UID: "cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:56:13.183346 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.183301    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-kube-api-access-9st47" (OuterVolumeSpecName: "kube-api-access-9st47") pod "cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" (UID: "cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb"). InnerVolumeSpecName "kube-api-access-9st47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:56:13.281852 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.281815    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:13.281852 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.281845    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:13.281852 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.281855    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9st47\" (UniqueName: \"kubernetes.io/projected/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb-kube-api-access-9st47\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:13.413409 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.413316    2564 generic.go:356] "Generic (PLEG): container finished" podID="cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" containerID="16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65" exitCode=0
Jul 07 11:56:13.413409 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.413403    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"
Jul 07 11:56:13.419915 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.419882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5" event={"ID":"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb","Type":"ContainerDied","Data":"16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65"}
Jul 07 11:56:13.420107 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.419948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5" event={"ID":"cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb","Type":"ContainerDied","Data":"70c035d31465a8fdc81dbca5b582dc9588bb21a2cda7c58542bc1fad83f6e408"}
Jul 07 11:56:13.420107 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.419985    2564 scope.go:117] "RemoveContainer" containerID="16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65"
Jul 07 11:56:13.433257 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.433238    2564 scope.go:117] "RemoveContainer" containerID="16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65"
Jul 07 11:56:13.433584 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:13.433554    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65\": container with ID starting with 16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65 not found: ID does not exist" containerID="16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65"
Jul 07 11:56:13.433666 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.433588    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65"} err="failed to get container status \"16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65\": rpc error: code = NotFound desc = could not find container \"16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65\": container with ID starting with 16c99b9a50c116057a6b5bc65f230b344610306ab8262f34b4b47f1f83384a65 not found: ID does not exist"
Jul 07 11:56:13.442290 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.442266    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"]
Jul 07 11:56:13.446163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:13.446141    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-044dd768-84f5d6796c-th7b5"]
Jul 07 11:56:15.419161 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:15.419127    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" path="/var/lib/kubelet/pods/cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb/volumes"
Jul 07 11:56:16.011385 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:16.011354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:18.637128 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:18.637081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:18.716550 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:18.716497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:18.892293 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:18.892202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:19.073686 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:19.073648    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:20.063146 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.063112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:20.105434 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.105402    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"]
Jul 07 11:56:20.105873 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.105859    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" containerName="maas-api"
Jul 07 11:56:20.105922 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.105875    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" containerName="maas-api"
Jul 07 11:56:20.105961 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.105939    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdf2f5f4-52a5-42d2-b5a7-eafefe61f0cb" containerName="maas-api"
Jul 07 11:56:20.110417 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.110397    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.113300 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.113278    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a4af068a-serving-cert\""
Jul 07 11:56:20.125770 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.125743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"]
Jul 07 11:56:20.149474 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.149440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jwqf\" (UniqueName: \"kubernetes.io/projected/3ff1583e-6765-4f2b-9323-15984ecf9b77-kube-api-access-9jwqf\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.149673 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.149489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff1583e-6765-4f2b-9323-15984ecf9b77-openshift-service-ca\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.149673 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.149600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.155585 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.155539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:20.222368 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.222334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:20.250436 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.250399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff1583e-6765-4f2b-9323-15984ecf9b77-openshift-service-ca\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.250610 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.250484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.250610 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.250516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jwqf\" (UniqueName: \"kubernetes.io/projected/3ff1583e-6765-4f2b-9323-15984ecf9b77-kube-api-access-9jwqf\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.250716 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:20.250650    2564 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-a4af068a-serving-cert: secret "maas-api-e2e-ait-a4af068a-serving-cert" not found
Jul 07 11:56:20.250751 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:20.250722    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls podName:3ff1583e-6765-4f2b-9323-15984ecf9b77 nodeName:}" failed. No retries permitted until 2026-07-07 11:56:20.750705818 +0000 UTC m=+1763.789930497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls") pod "maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh" (UID: "3ff1583e-6765-4f2b-9323-15984ecf9b77") : secret "maas-api-e2e-ait-a4af068a-serving-cert" not found
Jul 07 11:56:20.251120 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.251102    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff1583e-6765-4f2b-9323-15984ecf9b77-openshift-service-ca\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.260623 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.260586    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jwqf\" (UniqueName: \"kubernetes.io/projected/3ff1583e-6765-4f2b-9323-15984ecf9b77-kube-api-access-9jwqf\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.360172 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.360066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:20.683791 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.683738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:20.754948 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.754907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.757521 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.757497    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls\") pod \"maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") " pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:20.783915 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:20.783874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:21.021255 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:21.021159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:21.174667 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:21.174615    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"]
Jul 07 11:56:21.180987 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:56:21.180938    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff1583e_6765_4f2b_9323_15984ecf9b77.slice/crio-5d4e3d5ebf71b15480b0ae5bf63408fbbb07561bd1ddac2cd5f0f6673f073e1c WatchSource:0}: Error finding container 5d4e3d5ebf71b15480b0ae5bf63408fbbb07561bd1ddac2cd5f0f6673f073e1c: Status 404 returned error can't find the container with id 5d4e3d5ebf71b15480b0ae5bf63408fbbb07561bd1ddac2cd5f0f6673f073e1c
Jul 07 11:56:21.455032 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:21.455002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh" event={"ID":"3ff1583e-6765-4f2b-9323-15984ecf9b77","Type":"ContainerStarted","Data":"5d4e3d5ebf71b15480b0ae5bf63408fbbb07561bd1ddac2cd5f0f6673f073e1c"}
Jul 07 11:56:22.004720 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:22.004685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:22.462183 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:22.462136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh" event={"ID":"3ff1583e-6765-4f2b-9323-15984ecf9b77","Type":"ContainerStarted","Data":"97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78"}
Jul 07 11:56:22.462686 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:22.462216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:22.488828 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:22.488766    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh" podStartSLOduration=2.071224081 podStartE2EDuration="2.488746022s" totalImagesPullingTime="417.521941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:56:22.478877038 +0000 UTC m=+1765.518101740" watchObservedRunningTime="2026-07-07 11:56:22.488746022 +0000 UTC m=+1765.527970722"
Jul 07 11:56:25.080179 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.080122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:25.385274 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.385187    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"]
Jul 07 11:56:25.385438 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.385374    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh" podUID="3ff1583e-6765-4f2b-9323-15984ecf9b77" containerName="maas-api" containerID="cri-o://97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78" gracePeriod=30
Jul 07 11:56:25.402227 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.402202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:25.656592 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.656562    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:25.699650 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.699602    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls\") pod \"3ff1583e-6765-4f2b-9323-15984ecf9b77\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") "
Jul 07 11:56:25.699844 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.699676    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jwqf\" (UniqueName: \"kubernetes.io/projected/3ff1583e-6765-4f2b-9323-15984ecf9b77-kube-api-access-9jwqf\") pod \"3ff1583e-6765-4f2b-9323-15984ecf9b77\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") "
Jul 07 11:56:25.699844 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.699733    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff1583e-6765-4f2b-9323-15984ecf9b77-openshift-service-ca\") pod \"3ff1583e-6765-4f2b-9323-15984ecf9b77\" (UID: \"3ff1583e-6765-4f2b-9323-15984ecf9b77\") "
Jul 07 11:56:25.700112 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.700089    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ff1583e-6765-4f2b-9323-15984ecf9b77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ff1583e-6765-4f2b-9323-15984ecf9b77" (UID: "3ff1583e-6765-4f2b-9323-15984ecf9b77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:56:25.702002 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.701972    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff1583e-6765-4f2b-9323-15984ecf9b77-kube-api-access-9jwqf" (OuterVolumeSpecName: "kube-api-access-9jwqf") pod "3ff1583e-6765-4f2b-9323-15984ecf9b77" (UID: "3ff1583e-6765-4f2b-9323-15984ecf9b77"). InnerVolumeSpecName "kube-api-access-9jwqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:56:25.702182 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.702161    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ff1583e-6765-4f2b-9323-15984ecf9b77" (UID: "3ff1583e-6765-4f2b-9323-15984ecf9b77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:56:25.801253 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.801205    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ff1583e-6765-4f2b-9323-15984ecf9b77-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:25.801253 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.801250    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jwqf\" (UniqueName: \"kubernetes.io/projected/3ff1583e-6765-4f2b-9323-15984ecf9b77-kube-api-access-9jwqf\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:25.801253 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:25.801261    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ff1583e-6765-4f2b-9323-15984ecf9b77-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:26.485032 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.484990    2564 generic.go:356] "Generic (PLEG): container finished" podID="3ff1583e-6765-4f2b-9323-15984ecf9b77" containerID="97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78" exitCode=0
Jul 07 11:56:26.485508 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.485041    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"
Jul 07 11:56:26.485508 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.485081    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh" event={"ID":"3ff1583e-6765-4f2b-9323-15984ecf9b77","Type":"ContainerDied","Data":"97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78"}
Jul 07 11:56:26.485508 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.485138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh" event={"ID":"3ff1583e-6765-4f2b-9323-15984ecf9b77","Type":"ContainerDied","Data":"5d4e3d5ebf71b15480b0ae5bf63408fbbb07561bd1ddac2cd5f0f6673f073e1c"}
Jul 07 11:56:26.485508 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.485167    2564 scope.go:117] "RemoveContainer" containerID="97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78"
Jul 07 11:56:26.495936 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.495914    2564 scope.go:117] "RemoveContainer" containerID="97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78"
Jul 07 11:56:26.496266 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:26.496241    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78\": container with ID starting with 97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78 not found: ID does not exist" containerID="97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78"
Jul 07 11:56:26.496346 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.496276    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78"} err="failed to get container status \"97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78\": rpc error: code = NotFound desc = could not find container \"97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78\": container with ID starting with 97ac12ba2d80146bc194d7b27cb883cc5a8b7a29a53133fadfa775c88a42cd78 not found: ID does not exist"
Jul 07 11:56:26.508415 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.508379    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"]
Jul 07 11:56:26.512639 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:26.512598    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a4af068a-b6774d77f-hgkkh"]
Jul 07 11:56:27.418968 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:27.418930    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff1583e-6765-4f2b-9323-15984ecf9b77" path="/var/lib/kubelet/pods/3ff1583e-6765-4f2b-9323-15984ecf9b77/volumes"
Jul 07 11:56:31.167459 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:31.167424    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:31.267847 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:31.267809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:33.296472 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:33.296432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:37.024485 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:37.024450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:37.093720 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:37.093624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:37.317102 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:37.316996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:37.418243 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:37.418191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:38.441350 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.441306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:38.513984 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.513948    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"]
Jul 07 11:56:38.514947 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.514917    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff1583e-6765-4f2b-9323-15984ecf9b77" containerName="maas-api"
Jul 07 11:56:38.514947 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.514949    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff1583e-6765-4f2b-9323-15984ecf9b77" containerName="maas-api"
Jul 07 11:56:38.515098 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.515089    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff1583e-6765-4f2b-9323-15984ecf9b77" containerName="maas-api"
Jul 07 11:56:38.517195 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.517171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:38.518814 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.518793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.521744 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.521716    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-9131654a-serving-cert\""
Jul 07 11:56:38.527035 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.526995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"]
Jul 07 11:56:38.591674 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.591621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:38.621767 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.621706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.621970 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.621827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb6040ac-3298-413b-bd4e-0dd81f1327a6-openshift-service-ca\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.621970 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.621925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-897q6\" (UniqueName: \"kubernetes.io/projected/fb6040ac-3298-413b-bd4e-0dd81f1327a6-kube-api-access-897q6\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.723189 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.723087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-897q6\" (UniqueName: \"kubernetes.io/projected/fb6040ac-3298-413b-bd4e-0dd81f1327a6-kube-api-access-897q6\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.723189 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.723140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.723503 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.723218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb6040ac-3298-413b-bd4e-0dd81f1327a6-openshift-service-ca\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.723503 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:38.723327    2564 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-9131654a-serving-cert: secret "maas-api-e2e-derive-9131654a-serving-cert" not found
Jul 07 11:56:38.723503 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:38.723414    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls podName:fb6040ac-3298-413b-bd4e-0dd81f1327a6 nodeName:}" failed. No retries permitted until 2026-07-07 11:56:39.223393101 +0000 UTC m=+1782.262617780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls") pod "maas-api-e2e-derive-9131654a-d8757c6d9-nkq95" (UID: "fb6040ac-3298-413b-bd4e-0dd81f1327a6") : secret "maas-api-e2e-derive-9131654a-serving-cert" not found
Jul 07 11:56:38.723955 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.723937    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb6040ac-3298-413b-bd4e-0dd81f1327a6-openshift-service-ca\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.732182 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.732148    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-897q6\" (UniqueName: \"kubernetes.io/projected/fb6040ac-3298-413b-bd4e-0dd81f1327a6-kube-api-access-897q6\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:38.919196 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:38.919161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:39.020404 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:39.020296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:39.119753 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:39.119716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:39.228021 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:39.227986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:39.230852 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:39.230826    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls\") pod \"maas-api-e2e-derive-9131654a-d8757c6d9-nkq95\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") " pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:39.433624 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:39.433585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:39.591172 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:39.591137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"]
Jul 07 11:56:39.592590 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:56:39.592547    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6040ac_3298_413b_bd4e_0dd81f1327a6.slice/crio-8c188e6857abd17c54ed6200bf561fd088aa906cb077c0b9f9e8aea9c3e25ba7 WatchSource:0}: Error finding container 8c188e6857abd17c54ed6200bf561fd088aa906cb077c0b9f9e8aea9c3e25ba7: Status 404 returned error can't find the container with id 8c188e6857abd17c54ed6200bf561fd088aa906cb077c0b9f9e8aea9c3e25ba7
Jul 07 11:56:40.572558 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:40.572520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95" event={"ID":"fb6040ac-3298-413b-bd4e-0dd81f1327a6","Type":"ContainerStarted","Data":"4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0"}
Jul 07 11:56:40.572752 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:40.572575    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95" event={"ID":"fb6040ac-3298-413b-bd4e-0dd81f1327a6","Type":"ContainerStarted","Data":"8c188e6857abd17c54ed6200bf561fd088aa906cb077c0b9f9e8aea9c3e25ba7"}
Jul 07 11:56:40.572752 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:40.572731    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:40.615239 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:40.615182    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95" podStartSLOduration=2.273220668 podStartE2EDuration="2.615165112s" totalImagesPullingTime="341.944444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:56:40.612539177 +0000 UTC m=+1783.651763880" watchObservedRunningTime="2026-07-07 11:56:40.615165112 +0000 UTC m=+1783.654389813"
Jul 07 11:56:40.680876 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:40.680841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:42.799255 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:42.799220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:43.000653 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.000592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:43.098167 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.098071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:43.206081 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.206048    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"]
Jul 07 11:56:43.206278 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.206244    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95" podUID="fb6040ac-3298-413b-bd4e-0dd81f1327a6" containerName="maas-api" containerID="cri-o://4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0" gracePeriod=30
Jul 07 11:56:43.240699 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.240668    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:43.472438 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.472413    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:43.571057 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.571007    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-897q6\" (UniqueName: \"kubernetes.io/projected/fb6040ac-3298-413b-bd4e-0dd81f1327a6-kube-api-access-897q6\") pod \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") "
Jul 07 11:56:43.571244 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.571121    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls\") pod \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") "
Jul 07 11:56:43.571244 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.571207    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb6040ac-3298-413b-bd4e-0dd81f1327a6-openshift-service-ca\") pod \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\" (UID: \"fb6040ac-3298-413b-bd4e-0dd81f1327a6\") "
Jul 07 11:56:43.571615 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.571576    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb6040ac-3298-413b-bd4e-0dd81f1327a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb6040ac-3298-413b-bd4e-0dd81f1327a6" (UID: "fb6040ac-3298-413b-bd4e-0dd81f1327a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:56:43.573368 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.573340    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6040ac-3298-413b-bd4e-0dd81f1327a6-kube-api-access-897q6" (OuterVolumeSpecName: "kube-api-access-897q6") pod "fb6040ac-3298-413b-bd4e-0dd81f1327a6" (UID: "fb6040ac-3298-413b-bd4e-0dd81f1327a6"). InnerVolumeSpecName "kube-api-access-897q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:56:43.573509 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.573495    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb6040ac-3298-413b-bd4e-0dd81f1327a6" (UID: "fb6040ac-3298-413b-bd4e-0dd81f1327a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:56:43.597897 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.597860    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb6040ac-3298-413b-bd4e-0dd81f1327a6" containerID="4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0" exitCode=0
Jul 07 11:56:43.598091 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.597923    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"
Jul 07 11:56:43.598091 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.597955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95" event={"ID":"fb6040ac-3298-413b-bd4e-0dd81f1327a6","Type":"ContainerDied","Data":"4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0"}
Jul 07 11:56:43.598091 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.598045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95" event={"ID":"fb6040ac-3298-413b-bd4e-0dd81f1327a6","Type":"ContainerDied","Data":"8c188e6857abd17c54ed6200bf561fd088aa906cb077c0b9f9e8aea9c3e25ba7"}
Jul 07 11:56:43.598091 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.598077    2564 scope.go:117] "RemoveContainer" containerID="4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0"
Jul 07 11:56:43.608349 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.608325    2564 scope.go:117] "RemoveContainer" containerID="4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0"
Jul 07 11:56:43.608672 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:56:43.608644    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0\": container with ID starting with 4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0 not found: ID does not exist" containerID="4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0"
Jul 07 11:56:43.608779 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.608679    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0"} err="failed to get container status \"4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0\": rpc error: code = NotFound desc = could not find container \"4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0\": container with ID starting with 4482cc2bf48323924f6d5628c0f74b6a25225765f56ab34d92a3eaf9c0aebea0 not found: ID does not exist"
Jul 07 11:56:43.620809 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.620779    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"]
Jul 07 11:56:43.624416 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.624382    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-9131654a-d8757c6d9-nkq95"]
Jul 07 11:56:43.672883 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.672845    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-897q6\" (UniqueName: \"kubernetes.io/projected/fb6040ac-3298-413b-bd4e-0dd81f1327a6-kube-api-access-897q6\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:43.672883 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.672880    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb6040ac-3298-413b-bd4e-0dd81f1327a6-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:43.673101 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:43.672895    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb6040ac-3298-413b-bd4e-0dd81f1327a6-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:56:44.653157 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:44.653121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:45.420556 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:45.420507    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb6040ac-3298-413b-bd4e-0dd81f1327a6" path="/var/lib/kubelet/pods/fb6040ac-3298-413b-bd4e-0dd81f1327a6/volumes"
Jul 07 11:56:48.777132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:48.777052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:48.873376 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:48.873344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:49.292738 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:49.292684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:49.394452 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:49.394409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:50.808501 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:50.808449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:56.720865 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:56.720831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:56.826748 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:56.826710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:56.920864 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:56.920834    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:57.020999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:57.020910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:57.469008 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:57.468971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:56:57.516489 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:57.516463    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:56:57.526786 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:56:57.526762    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 11:57:23.454906 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:23.454867    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:57:29.496272 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:29.496233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:57:29.635853 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:29.635816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:57:29.795951 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:29.795860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:57:45.613242 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:45.613205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:57:51.338253 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:51.338210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:57:51.443901 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:51.443857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:57:51.537954 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:57:51.537915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:02.042185 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:02.042152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:02.912491 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:02.912454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:08.805683 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:08.805644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:08.906600 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:08.906563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:09.005845 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:09.005811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:09.105898 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:09.105810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:09.810784 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:09.810754    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:09.910553 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:09.910519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:10.010527 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:10.010491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:11.609892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:11.609856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:17.386001 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:17.385961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:17.449501 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:17.449421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:18.058127 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:18.058095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:24.076054 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:24.076014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:24.177151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:24.177102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:24.297830 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:24.297799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:24.621931 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:24.621893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:24.856557 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:24.856522    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:27.828151 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.828115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:27.904801 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.904767    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"]
Jul 07 11:58:27.905203 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.905189    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6040ac-3298-413b-bd4e-0dd81f1327a6" containerName="maas-api"
Jul 07 11:58:27.905203 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.905203    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6040ac-3298-413b-bd4e-0dd81f1327a6" containerName="maas-api"
Jul 07 11:58:27.905326 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.905282    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb6040ac-3298-413b-bd4e-0dd81f1327a6" containerName="maas-api"
Jul 07 11:58:27.908505 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.908486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:27.911016 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.910986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:27.911131 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.911109    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-5e15070c-serving-cert\""
Jul 07 11:58:27.918916 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.918890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"]
Jul 07 11:58:27.989149 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:27.989106    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:28.038124 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.038088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg78m\" (UniqueName: \"kubernetes.io/projected/318ff020-1c39-495d-9b66-c3947c1ba3a9-kube-api-access-fg78m\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.038291 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.038165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/318ff020-1c39-495d-9b66-c3947c1ba3a9-maas-api-tls\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.038291 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.038260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/318ff020-1c39-495d-9b66-c3947c1ba3a9-openshift-service-ca\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.139344 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.139250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/318ff020-1c39-495d-9b66-c3947c1ba3a9-maas-api-tls\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.139344 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.139309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/318ff020-1c39-495d-9b66-c3947c1ba3a9-openshift-service-ca\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.139590 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.139366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg78m\" (UniqueName: \"kubernetes.io/projected/318ff020-1c39-495d-9b66-c3947c1ba3a9-kube-api-access-fg78m\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.140044 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.140021    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/318ff020-1c39-495d-9b66-c3947c1ba3a9-openshift-service-ca\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.141915 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.141895    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/318ff020-1c39-495d-9b66-c3947c1ba3a9-maas-api-tls\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.152374 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.152353    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg78m\" (UniqueName: \"kubernetes.io/projected/318ff020-1c39-495d-9b66-c3947c1ba3a9-kube-api-access-fg78m\") pod \"maas-api-e2e-mt-5e15070c-55588dc79-j6jgs\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") " pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.190200 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.190167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:28.222561 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.222526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:28.374486 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.374452    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"]
Jul 07 11:58:28.376964 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:58:28.376931    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318ff020_1c39_495d_9b66_c3947c1ba3a9.slice/crio-2fc2b3daeaac872610146cbd35e31577a7731b332c68cc8ac1ae360d2519cf12 WatchSource:0}: Error finding container 2fc2b3daeaac872610146cbd35e31577a7731b332c68cc8ac1ae360d2519cf12: Status 404 returned error can't find the container with id 2fc2b3daeaac872610146cbd35e31577a7731b332c68cc8ac1ae360d2519cf12
Jul 07 11:58:28.382199 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.382168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:28.483862 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:28.483826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:29.169679 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:29.169613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs" event={"ID":"318ff020-1c39-495d-9b66-c3947c1ba3a9","Type":"ContainerStarted","Data":"24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65"}
Jul 07 11:58:29.170044 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:29.169717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs" event={"ID":"318ff020-1c39-495d-9b66-c3947c1ba3a9","Type":"ContainerStarted","Data":"2fc2b3daeaac872610146cbd35e31577a7731b332c68cc8ac1ae360d2519cf12"}
Jul 07 11:58:29.190007 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:29.189955    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs" podStartSLOduration=1.7987575709999999 podStartE2EDuration="2.18993699s" totalImagesPullingTime="391.179419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:58:29.188158998 +0000 UTC m=+1892.227383699" watchObservedRunningTime="2026-07-07 11:58:29.18993699 +0000 UTC m=+1892.229161712"
Jul 07 11:58:30.175920 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:30.175886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:32.233359 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:32.233325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:32.889655 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:32.889591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:32.987104 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:32.987067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:33.327473 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:33.327437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:36.187685 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:36.187656    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:39.037339 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.037290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:39.138430 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.138398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:39.420191 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.420166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:39.721529 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.721439    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"]
Jul 07 11:58:39.721780 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.721752    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs" podUID="318ff020-1c39-495d-9b66-c3947c1ba3a9" containerName="maas-api" containerID="cri-o://24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65" gracePeriod=30
Jul 07 11:58:39.749361 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.749333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:39.824779 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.824744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:39.986621 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:39.986557    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:40.052184 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.052148    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg78m\" (UniqueName: \"kubernetes.io/projected/318ff020-1c39-495d-9b66-c3947c1ba3a9-kube-api-access-fg78m\") pod \"318ff020-1c39-495d-9b66-c3947c1ba3a9\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") "
Jul 07 11:58:40.052677 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.052194    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/318ff020-1c39-495d-9b66-c3947c1ba3a9-openshift-service-ca\") pod \"318ff020-1c39-495d-9b66-c3947c1ba3a9\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") "
Jul 07 11:58:40.052677 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.052257    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/318ff020-1c39-495d-9b66-c3947c1ba3a9-maas-api-tls\") pod \"318ff020-1c39-495d-9b66-c3947c1ba3a9\" (UID: \"318ff020-1c39-495d-9b66-c3947c1ba3a9\") "
Jul 07 11:58:40.052677 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.052537    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/318ff020-1c39-495d-9b66-c3947c1ba3a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "318ff020-1c39-495d-9b66-c3947c1ba3a9" (UID: "318ff020-1c39-495d-9b66-c3947c1ba3a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:58:40.052795 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.052678    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/318ff020-1c39-495d-9b66-c3947c1ba3a9-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:58:40.054513 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.054489    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/318ff020-1c39-495d-9b66-c3947c1ba3a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "318ff020-1c39-495d-9b66-c3947c1ba3a9" (UID: "318ff020-1c39-495d-9b66-c3947c1ba3a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:58:40.054603 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.054553    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/318ff020-1c39-495d-9b66-c3947c1ba3a9-kube-api-access-fg78m" (OuterVolumeSpecName: "kube-api-access-fg78m") pod "318ff020-1c39-495d-9b66-c3947c1ba3a9" (UID: "318ff020-1c39-495d-9b66-c3947c1ba3a9"). InnerVolumeSpecName "kube-api-access-fg78m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:58:40.153262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.153222    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg78m\" (UniqueName: \"kubernetes.io/projected/318ff020-1c39-495d-9b66-c3947c1ba3a9-kube-api-access-fg78m\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:58:40.153262 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.153255    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/318ff020-1c39-495d-9b66-c3947c1ba3a9-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:58:40.232341 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.232305    2564 generic.go:356] "Generic (PLEG): container finished" podID="318ff020-1c39-495d-9b66-c3947c1ba3a9" containerID="24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65" exitCode=0
Jul 07 11:58:40.232487 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.232352    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"
Jul 07 11:58:40.232487 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.232380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs" event={"ID":"318ff020-1c39-495d-9b66-c3947c1ba3a9","Type":"ContainerDied","Data":"24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65"}
Jul 07 11:58:40.232487 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.232431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs" event={"ID":"318ff020-1c39-495d-9b66-c3947c1ba3a9","Type":"ContainerDied","Data":"2fc2b3daeaac872610146cbd35e31577a7731b332c68cc8ac1ae360d2519cf12"}
Jul 07 11:58:40.232487 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.232453    2564 scope.go:117] "RemoveContainer" containerID="24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65"
Jul 07 11:58:40.242395 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.242377    2564 scope.go:117] "RemoveContainer" containerID="24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65"
Jul 07 11:58:40.242693 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:58:40.242671    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65\": container with ID starting with 24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65 not found: ID does not exist" containerID="24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65"
Jul 07 11:58:40.242760 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.242702    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65"} err="failed to get container status \"24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65\": rpc error: code = NotFound desc = could not find container \"24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65\": container with ID starting with 24fc355fe8009e0e1cfead9671a3892b3a4effe106f937f79743694f7a8d4e65 not found: ID does not exist"
Jul 07 11:58:40.254136 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.254106    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"]
Jul 07 11:58:40.261905 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:40.261879    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-5e15070c-55588dc79-j6jgs"]
Jul 07 11:58:41.419829 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:41.419795    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="318ff020-1c39-495d-9b66-c3947c1ba3a9" path="/var/lib/kubelet/pods/318ff020-1c39-495d-9b66-c3947c1ba3a9/volumes"
Jul 07 11:58:45.726762 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:45.726721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:45.927674 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:45.927642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:46.003401 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:46.003318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:46.210278 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:46.210238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:46.334274 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:46.334187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:46.432892 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:46.432858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:46.537956 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:46.537914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:52.121294 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:52.121259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:52.225760 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:52.225727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:52.330654 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:52.330589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:52.519182 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:52.519144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:57.572209 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:57.572170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:58.238832 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:58.238801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:58:58.339741 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:58:58.339711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:04.978158 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:04.978121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:05.293536 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:05.293452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:05.519762 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:05.519726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:07.930564 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:07.930533    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:08.013132 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.013094    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"]
Jul 07 11:59:08.013807 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.013783    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="318ff020-1c39-495d-9b66-c3947c1ba3a9" containerName="maas-api"
Jul 07 11:59:08.013807 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.013806    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="318ff020-1c39-495d-9b66-c3947c1ba3a9" containerName="maas-api"
Jul 07 11:59:08.014029 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.013948    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="318ff020-1c39-495d-9b66-c3947c1ba3a9" containerName="maas-api"
Jul 07 11:59:08.017163 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.017137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.019926 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.019901    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-b80bcdc6-serving-cert\""
Jul 07 11:59:08.021376 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.021352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:08.031000 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.030974    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"]
Jul 07 11:59:08.109340 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.109297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:08.121192 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.121158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec6da8df-4d98-49e8-afd6-becd3abbe913-openshift-service-ca\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.121368 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.121210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.121368 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.121233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmpn5\" (UniqueName: \"kubernetes.io/projected/ec6da8df-4d98-49e8-afd6-becd3abbe913-kube-api-access-jmpn5\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.222153 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.222062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec6da8df-4d98-49e8-afd6-becd3abbe913-openshift-service-ca\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.222153 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.222106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.222344 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:59:08.222212    2564 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-b80bcdc6-serving-cert: secret "maas-api-e2e-mt-b80bcdc6-serving-cert" not found
Jul 07 11:59:08.222344 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.222232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmpn5\" (UniqueName: \"kubernetes.io/projected/ec6da8df-4d98-49e8-afd6-becd3abbe913-kube-api-access-jmpn5\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.222344 ip-10-0-129-12 kubenswrapper[2564]: E0707 11:59:08.222286    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls podName:ec6da8df-4d98-49e8-afd6-becd3abbe913 nodeName:}" failed. No retries permitted until 2026-07-07 11:59:08.722267057 +0000 UTC m=+1931.761491738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls") pod "maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz" (UID: "ec6da8df-4d98-49e8-afd6-becd3abbe913") : secret "maas-api-e2e-mt-b80bcdc6-serving-cert" not found
Jul 07 11:59:08.222719 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.222701    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec6da8df-4d98-49e8-afd6-becd3abbe913-openshift-service-ca\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.230999 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.230970    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmpn5\" (UniqueName: \"kubernetes.io/projected/ec6da8df-4d98-49e8-afd6-becd3abbe913-kube-api-access-jmpn5\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.564905 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.564820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:08.665517 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.665479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:08.727782 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.727748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.730496 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.730475    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls\") pod \"maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") " pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:08.929089 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:08.929058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:09.077406 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:09.077368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"]
Jul 07 11:59:09.078296 ip-10-0-129-12 kubenswrapper[2564]: W0707 11:59:09.078270    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6da8df_4d98_49e8_afd6_becd3abbe913.slice/crio-9143e4402e4f031d5e4ba6e4116a0c22a40195a915b1f63072e01dbfcc17a490 WatchSource:0}: Error finding container 9143e4402e4f031d5e4ba6e4116a0c22a40195a915b1f63072e01dbfcc17a490: Status 404 returned error can't find the container with id 9143e4402e4f031d5e4ba6e4116a0c22a40195a915b1f63072e01dbfcc17a490
Jul 07 11:59:09.398374 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:09.398281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz" event={"ID":"ec6da8df-4d98-49e8-afd6-becd3abbe913","Type":"ContainerStarted","Data":"9143e4402e4f031d5e4ba6e4116a0c22a40195a915b1f63072e01dbfcc17a490"}
Jul 07 11:59:10.404792 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:10.404761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz" event={"ID":"ec6da8df-4d98-49e8-afd6-becd3abbe913","Type":"ContainerStarted","Data":"35c32aa55e2b343e3758053f3e4dc7489b072ccf8aa2f89761acf32a1cf93084"}
Jul 07 11:59:10.405214 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:10.404884    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:10.422447 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:10.422385    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz" podStartSLOduration=3.054956692 podStartE2EDuration="3.422365329s" totalImagesPullingTime="367.408637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:59:10.421952127 +0000 UTC m=+1933.461176829" watchObservedRunningTime="2026-07-07 11:59:10.422365329 +0000 UTC m=+1933.461590031"
Jul 07 11:59:12.419573 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:12.419538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:16.415922 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:16.415887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:25.831301 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:25.831263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:25.934095 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:25.934057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:27.355746 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:27.355711    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:29.198264 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:29.198221    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:29.299828 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:29.299790    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:49.930131 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:49.930055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:50.416073 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.415980    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"]
Jul 07 11:59:50.416337 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.416306    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz" podUID="ec6da8df-4d98-49e8-afd6-becd3abbe913" containerName="maas-api" containerID="cri-o://35c32aa55e2b343e3758053f3e4dc7489b072ccf8aa2f89761acf32a1cf93084" gracePeriod=30
Jul 07 11:59:50.449448 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.449418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 11:59:50.632070 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.632040    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec6da8df-4d98-49e8-afd6-becd3abbe913" containerID="35c32aa55e2b343e3758053f3e4dc7489b072ccf8aa2f89761acf32a1cf93084" exitCode=0
Jul 07 11:59:50.632251 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.632122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz" event={"ID":"ec6da8df-4d98-49e8-afd6-becd3abbe913","Type":"ContainerDied","Data":"35c32aa55e2b343e3758053f3e4dc7489b072ccf8aa2f89761acf32a1cf93084"}
Jul 07 11:59:50.694209 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.694185    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:50.816794 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.816752    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls\") pod \"ec6da8df-4d98-49e8-afd6-becd3abbe913\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") "
Jul 07 11:59:50.816794 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.816792    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmpn5\" (UniqueName: \"kubernetes.io/projected/ec6da8df-4d98-49e8-afd6-becd3abbe913-kube-api-access-jmpn5\") pod \"ec6da8df-4d98-49e8-afd6-becd3abbe913\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") "
Jul 07 11:59:50.817008 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.816820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec6da8df-4d98-49e8-afd6-becd3abbe913-openshift-service-ca\") pod \"ec6da8df-4d98-49e8-afd6-becd3abbe913\" (UID: \"ec6da8df-4d98-49e8-afd6-becd3abbe913\") "
Jul 07 11:59:50.817160 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.817136    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec6da8df-4d98-49e8-afd6-becd3abbe913-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec6da8df-4d98-49e8-afd6-becd3abbe913" (UID: "ec6da8df-4d98-49e8-afd6-becd3abbe913"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:59:50.819168 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.819136    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec6da8df-4d98-49e8-afd6-becd3abbe913" (UID: "ec6da8df-4d98-49e8-afd6-becd3abbe913"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:59:50.819168 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.819136    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6da8df-4d98-49e8-afd6-becd3abbe913-kube-api-access-jmpn5" (OuterVolumeSpecName: "kube-api-access-jmpn5") pod "ec6da8df-4d98-49e8-afd6-becd3abbe913" (UID: "ec6da8df-4d98-49e8-afd6-becd3abbe913"). InnerVolumeSpecName "kube-api-access-jmpn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:59:50.917585 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.917548    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec6da8df-4d98-49e8-afd6-becd3abbe913-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:59:50.917585 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.917580    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmpn5\" (UniqueName: \"kubernetes.io/projected/ec6da8df-4d98-49e8-afd6-becd3abbe913-kube-api-access-jmpn5\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:59:50.917585 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:50.917590    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec6da8df-4d98-49e8-afd6-becd3abbe913-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 11:59:51.638726 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:51.638693    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"
Jul 07 11:59:51.639149 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:51.638684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz" event={"ID":"ec6da8df-4d98-49e8-afd6-becd3abbe913","Type":"ContainerDied","Data":"9143e4402e4f031d5e4ba6e4116a0c22a40195a915b1f63072e01dbfcc17a490"}
Jul 07 11:59:51.639149 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:51.638827    2564 scope.go:117] "RemoveContainer" containerID="35c32aa55e2b343e3758053f3e4dc7489b072ccf8aa2f89761acf32a1cf93084"
Jul 07 11:59:51.684663 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:51.684556    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"]
Jul 07 11:59:51.692311 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:51.692285    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-b80bcdc6-85cc45498f-q5fgz"]
Jul 07 11:59:53.421454 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:53.421409    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6da8df-4d98-49e8-afd6-becd3abbe913" path="/var/lib/kubelet/pods/ec6da8df-4d98-49e8-afd6-becd3abbe913/volumes"
Jul 07 11:59:56.109694 ip-10-0-129-12 kubenswrapper[2564]: I0707 11:59:56.109658    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:00.139255 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.139215    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723760-drztt"]
Jul 07 12:00:00.139727 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.139683    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6da8df-4d98-49e8-afd6-becd3abbe913" containerName="maas-api"
Jul 07 12:00:00.139727 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.139694    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6da8df-4d98-49e8-afd6-becd3abbe913" containerName="maas-api"
Jul 07 12:00:00.139825 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.139765    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6da8df-4d98-49e8-afd6-becd3abbe913" containerName="maas-api"
Jul 07 12:00:00.142938 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.142921    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723760-drztt"
Jul 07 12:00:00.150384 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.150354    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723760-drztt"]
Jul 07 12:00:00.198061 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.198014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89hxd\" (UniqueName: \"kubernetes.io/projected/17fa6179-d954-4ec0-997d-fc2bf0426e89-kube-api-access-89hxd\") pod \"maas-api-key-cleanup-29723760-drztt\" (UID: \"17fa6179-d954-4ec0-997d-fc2bf0426e89\") " pod="opendatahub/maas-api-key-cleanup-29723760-drztt"
Jul 07 12:00:00.298783 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.298745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89hxd\" (UniqueName: \"kubernetes.io/projected/17fa6179-d954-4ec0-997d-fc2bf0426e89-kube-api-access-89hxd\") pod \"maas-api-key-cleanup-29723760-drztt\" (UID: \"17fa6179-d954-4ec0-997d-fc2bf0426e89\") " pod="opendatahub/maas-api-key-cleanup-29723760-drztt"
Jul 07 12:00:00.308722 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.308685    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89hxd\" (UniqueName: \"kubernetes.io/projected/17fa6179-d954-4ec0-997d-fc2bf0426e89-kube-api-access-89hxd\") pod \"maas-api-key-cleanup-29723760-drztt\" (UID: \"17fa6179-d954-4ec0-997d-fc2bf0426e89\") " pod="opendatahub/maas-api-key-cleanup-29723760-drztt"
Jul 07 12:00:00.455438 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.455391    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723760-drztt"
Jul 07 12:00:00.597379 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.597341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723760-drztt"]
Jul 07 12:00:00.600617 ip-10-0-129-12 kubenswrapper[2564]: W0707 12:00:00.600586    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fa6179_d954_4ec0_997d_fc2bf0426e89.slice/crio-82c065cb711ec59d73fbf0bed9007828d17350ffab4703e7d96e6dd5c96e03f4 WatchSource:0}: Error finding container 82c065cb711ec59d73fbf0bed9007828d17350ffab4703e7d96e6dd5c96e03f4: Status 404 returned error can't find the container with id 82c065cb711ec59d73fbf0bed9007828d17350ffab4703e7d96e6dd5c96e03f4
Jul 07 12:00:00.688797 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:00.688754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723760-drztt" event={"ID":"17fa6179-d954-4ec0-997d-fc2bf0426e89","Type":"ContainerStarted","Data":"82c065cb711ec59d73fbf0bed9007828d17350ffab4703e7d96e6dd5c96e03f4"}
Jul 07 12:00:01.164559 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:01.164467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:01.695931 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:01.695901    2564 generic.go:356] "Generic (PLEG): container finished" podID="17fa6179-d954-4ec0-997d-fc2bf0426e89" containerID="3904c40f8274d0a711b0bcda2f4a8683299be16d88222f288083f22c2cfeb655" exitCode=0
Jul 07 12:00:01.696108 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:01.695983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723760-drztt" event={"ID":"17fa6179-d954-4ec0-997d-fc2bf0426e89","Type":"ContainerDied","Data":"3904c40f8274d0a711b0bcda2f4a8683299be16d88222f288083f22c2cfeb655"}
Jul 07 12:00:02.844942 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:02.844915    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723760-drztt"
Jul 07 12:00:02.917290 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:02.917256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89hxd\" (UniqueName: \"kubernetes.io/projected/17fa6179-d954-4ec0-997d-fc2bf0426e89-kube-api-access-89hxd\") pod \"17fa6179-d954-4ec0-997d-fc2bf0426e89\" (UID: \"17fa6179-d954-4ec0-997d-fc2bf0426e89\") "
Jul 07 12:00:02.919486 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:02.919461    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17fa6179-d954-4ec0-997d-fc2bf0426e89-kube-api-access-89hxd" (OuterVolumeSpecName: "kube-api-access-89hxd") pod "17fa6179-d954-4ec0-997d-fc2bf0426e89" (UID: "17fa6179-d954-4ec0-997d-fc2bf0426e89"). InnerVolumeSpecName "kube-api-access-89hxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:00:03.018100 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:03.018019    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89hxd\" (UniqueName: \"kubernetes.io/projected/17fa6179-d954-4ec0-997d-fc2bf0426e89-kube-api-access-89hxd\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:00:03.708702 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:03.708590    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723760-drztt"
Jul 07 12:00:03.708702 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:03.708668    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723760-drztt" event={"ID":"17fa6179-d954-4ec0-997d-fc2bf0426e89","Type":"ContainerDied","Data":"82c065cb711ec59d73fbf0bed9007828d17350ffab4703e7d96e6dd5c96e03f4"}
Jul 07 12:00:03.708939 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:03.708718    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82c065cb711ec59d73fbf0bed9007828d17350ffab4703e7d96e6dd5c96e03f4"
Jul 07 12:00:37.711569 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:37.711536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:38.281504 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:38.281457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:43.987677 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:43.987645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:45.618376 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:45.618337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:45.717769 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:45.717723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:46.531022 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:46.530993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:46.627612 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:46.627576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:47.409453 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:47.409419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:48.088157 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:48.088123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:53.908050 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:53.908011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:53.972525 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:53.972483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:00:54.555017 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:00:54.554980    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:00.274737 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:00.274701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:00.344353 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:00.344318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:00.425948 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:00.425898    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:00.524892 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:00.524795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:10.988568 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:10.988536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:11.324498 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:11.324422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:32.252051 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:32.252016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:38.070068 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.070032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:38.176037 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.176003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:38.423804 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.423769    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:38.709526 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.709426    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"]
Jul 07 12:01:38.710819 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.710791    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17fa6179-d954-4ec0-997d-fc2bf0426e89" containerName="cleanup"
Jul 07 12:01:38.710985 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.710972    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17fa6179-d954-4ec0-997d-fc2bf0426e89" containerName="cleanup"
Jul 07 12:01:38.711363 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.711348    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="17fa6179-d954-4ec0-997d-fc2bf0426e89" containerName="cleanup"
Jul 07 12:01:38.715748 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.715725    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.718885 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.718861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-302b88-openshift-default-dockercfg-2rcnj\""
Jul 07 12:01:38.719016 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.718865    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 12:01:38.724247 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.724202    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"]
Jul 07 12:01:38.733068 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.733042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:38.828316 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-certs\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828316 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs84w\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-kube-api-access-rs84w\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828563 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-podinfo\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828563 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-socket\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828563 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istiod-ca-cert\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828563 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-token\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828749 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828566    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-credential-socket\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828749 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-data\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.828749 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.828614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-envoy\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.855357 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.855323    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:38.929719 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.929679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-envoy\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.929909 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.929724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-certs\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.929909 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.929854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs84w\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-kube-api-access-rs84w\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930029 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.929907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-podinfo\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930029 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.929957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-socket\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930029 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.929978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istiod-ca-cert\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930029 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-token\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930234 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930123    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-certs\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930314 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930262    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-socket\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930468 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-credential-socket\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930539 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-data\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930792 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930770    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istiod-ca-cert\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930881 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930787    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-credential-socket\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.930881 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.930832    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-data\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.932261 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.932236    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-envoy\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.932377 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.932359    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-podinfo\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.938213 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.938190    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-token\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:38.938299 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:38.938253    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs84w\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-kube-api-access-rs84w\") pod \"e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") " pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:39.029073 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:39.028978    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:39.180176 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:39.180143    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"]
Jul 07 12:01:39.182122 ip-10-0-129-12 kubenswrapper[2564]: W0707 12:01:39.182095    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d84e9ba_4d32_4f4c_b0a2_84cc5075831f.slice/crio-5cf7ccdad07c67dee9dd40f419619be0fb7f7bf93cde546dcb18f9206b6a57a1 WatchSource:0}: Error finding container 5cf7ccdad07c67dee9dd40f419619be0fb7f7bf93cde546dcb18f9206b6a57a1: Status 404 returned error can't find the container with id 5cf7ccdad07c67dee9dd40f419619be0fb7f7bf93cde546dcb18f9206b6a57a1
Jul 07 12:01:39.184180 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:39.184157    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 12:01:39.246508 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:39.246474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" event={"ID":"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f","Type":"ContainerStarted","Data":"5cf7ccdad07c67dee9dd40f419619be0fb7f7bf93cde546dcb18f9206b6a57a1"}
Jul 07 12:01:41.937335 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:41.937302    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:01:41.937591 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:41.937371    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:01:41.937591 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:41.937399    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:01:42.267136 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:42.267046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" event={"ID":"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f","Type":"ContainerStarted","Data":"f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc"}
Jul 07 12:01:42.292319 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:42.292262    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" podStartSLOduration=1.539528767 podStartE2EDuration="4.292241004s" totalImagesPullingTime="2.752712237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:01:42.290456194 +0000 UTC m=+2085.329680896" watchObservedRunningTime="2026-07-07 12:01:42.292241004 +0000 UTC m=+2085.331465705"
Jul 07 12:01:43.029611 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:43.029569    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:43.034863 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:43.034831    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:43.272775 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:43.272741    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:43.273844 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:43.273824    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:44.176607 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:44.176554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:44.276346 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:44.276306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:44.457049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:44.456933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:44.945709 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:44.945674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:45.047097 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:45.047059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:45.149185 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:45.149145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:48.668989 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:48.668941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:48.992508 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:48.992407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:49.313422 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:49.313310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:50.158097 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:50.158059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:51.824702 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:51.824662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:51.903412 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:51.903375    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"]
Jul 07 12:01:51.908053 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:51.908019    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:51.911119 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:51.911088    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-02e907-serving-cert\""
Jul 07 12:01:51.918943 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:51.918661    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"]
Jul 07 12:01:51.924911 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:51.924869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:52.023574 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.023517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:52.056717 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.056682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee88768f-e768-433f-b5e3-3fe42a6e3706-maas-api-tls\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.056907 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.056821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee88768f-e768-433f-b5e3-3fe42a6e3706-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.056907 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.056855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdlfc\" (UniqueName: \"kubernetes.io/projected/ee88768f-e768-433f-b5e3-3fe42a6e3706-kube-api-access-fdlfc\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.152312 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.152215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:52.157477 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.157451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee88768f-e768-433f-b5e3-3fe42a6e3706-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.157613 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.157487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdlfc\" (UniqueName: \"kubernetes.io/projected/ee88768f-e768-433f-b5e3-3fe42a6e3706-kube-api-access-fdlfc\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.157738 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.157714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee88768f-e768-433f-b5e3-3fe42a6e3706-maas-api-tls\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.158157 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.158135    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee88768f-e768-433f-b5e3-3fe42a6e3706-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.162276 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.162250    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee88768f-e768-433f-b5e3-3fe42a6e3706-maas-api-tls\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.167302 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.167242    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdlfc\" (UniqueName: \"kubernetes.io/projected/ee88768f-e768-433f-b5e3-3fe42a6e3706-kube-api-access-fdlfc\") pod \"maas-api-e2e-inf-b-02e907-5448d7784c-72xhk\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") " pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.224055 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.224012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:52.425670 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.425620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"]
Jul 07 12:01:52.427182 ip-10-0-129-12 kubenswrapper[2564]: W0707 12:01:52.427156    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee88768f_e768_433f_b5e3_3fe42a6e3706.slice/crio-9ceab4de3b13be9c4030030d47f1a2d54bdfa9b1a08407bb24dc7b742789966d WatchSource:0}: Error finding container 9ceab4de3b13be9c4030030d47f1a2d54bdfa9b1a08407bb24dc7b742789966d: Status 404 returned error can't find the container with id 9ceab4de3b13be9c4030030d47f1a2d54bdfa9b1a08407bb24dc7b742789966d
Jul 07 12:01:52.488669 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.486126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:52.588248 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:52.588176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:53.334293 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:53.334250    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk" event={"ID":"ee88768f-e768-433f-b5e3-3fe42a6e3706","Type":"ContainerStarted","Data":"9ceab4de3b13be9c4030030d47f1a2d54bdfa9b1a08407bb24dc7b742789966d"}
Jul 07 12:01:54.342897 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:54.342859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk" event={"ID":"ee88768f-e768-433f-b5e3-3fe42a6e3706","Type":"ContainerStarted","Data":"542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e"}
Jul 07 12:01:54.343308 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:54.342995    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:01:54.385611 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:54.385544    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk" podStartSLOduration=1.922192887 podStartE2EDuration="3.385522824s" totalImagesPullingTime="1.463329937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:01:54.383902655 +0000 UTC m=+2097.423127356" watchObservedRunningTime="2026-07-07 12:01:54.385522824 +0000 UTC m=+2097.424747526"
Jul 07 12:01:56.313839 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:56.313747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:01:56.356220 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:56.356182    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerID="f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc" exitCode=0
Jul 07 12:01:56.356388 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:56.356242    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" event={"ID":"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f","Type":"ContainerDied","Data":"f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc"}
Jul 07 12:01:56.356681 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:56.356667    2564 scope.go:117] "RemoveContainer" containerID="f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc"
Jul 07 12:01:56.358825 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:56.358789    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:01:56.358908 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:56.358892    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:01:56.358959 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:56.358938    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:01:57.366671 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:57.365734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" event={"ID":"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f","Type":"ContainerStarted","Data":"28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc"}
Jul 07 12:01:57.555935 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:57.555905    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 12:01:57.594967 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:57.594934    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 12:01:58.030155 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:58.030125    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:58.031510 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:58.031480    2564 patch_prober.go:28] interesting pod/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 07 12:01:58.031675 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:58.031546    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 07 12:01:58.273095 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:58.273048    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:01:59.030168 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:59.030131    2564 patch_prober.go:28] interesting pod/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 07 12:01:59.030591 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:01:59.030186    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 07 12:02:00.030050 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:00.030013    2564 patch_prober.go:28] interesting pod/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 07 12:02:00.030245 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:00.030075    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 07 12:02:00.354515 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:00.354439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:02:01.029880 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:01.029845    2564 patch_prober.go:28] interesting pod/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 07 12:02:01.030072 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:01.029901    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 07 12:02:01.841541 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:01.841504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:02.033612 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:02.033575    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:02:02.034729 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:02.034713    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:02:05.669664 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:05.669591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:05.769858 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:05.769824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:14.168192 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:14.168156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:14.427867 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:14.427770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:22.826494 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:22.826464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:39.319303 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:39.319265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:40.300932 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:40.300893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:40.457814 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:40.457776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:40.841066 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:40.841029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:41.661624 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:41.661575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:41.764091 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:41.764028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:02:45.911918 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:02:45.911875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:05.832485 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:05.832377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:05.932917 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:05.932874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:18.600166 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:18.600122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:22.653955 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:22.653906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:22.830951 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:22.830911    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"]
Jul 07 12:03:22.831164 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:22.831135    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy" containerID="cri-o://28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc" gracePeriod=30
Jul 07 12:03:22.858619 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:22.858585    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:23.087128 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:23.087091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:23.415179 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:23.415074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:23.784317 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:23.784281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:23.884842 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:23.884799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:23.985965 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:23.985931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:24.189985 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.189956    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"]
Jul 07 12:03:24.190160 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.190126    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk" podUID="ee88768f-e768-433f-b5e3-3fe42a6e3706" containerName="maas-api" containerID="cri-o://542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e" gracePeriod=30
Jul 07 12:03:24.210928 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.210900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:24.446615 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.446553    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:03:24.540156 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.540117    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdlfc\" (UniqueName: \"kubernetes.io/projected/ee88768f-e768-433f-b5e3-3fe42a6e3706-kube-api-access-fdlfc\") pod \"ee88768f-e768-433f-b5e3-3fe42a6e3706\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") "
Jul 07 12:03:24.540366 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.540243    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee88768f-e768-433f-b5e3-3fe42a6e3706-openshift-service-ca\") pod \"ee88768f-e768-433f-b5e3-3fe42a6e3706\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") "
Jul 07 12:03:24.540366 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.540281    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee88768f-e768-433f-b5e3-3fe42a6e3706-maas-api-tls\") pod \"ee88768f-e768-433f-b5e3-3fe42a6e3706\" (UID: \"ee88768f-e768-433f-b5e3-3fe42a6e3706\") "
Jul 07 12:03:24.540594 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.540569    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee88768f-e768-433f-b5e3-3fe42a6e3706-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee88768f-e768-433f-b5e3-3fe42a6e3706" (UID: "ee88768f-e768-433f-b5e3-3fe42a6e3706"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:03:24.542466 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.542443    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee88768f-e768-433f-b5e3-3fe42a6e3706-kube-api-access-fdlfc" (OuterVolumeSpecName: "kube-api-access-fdlfc") pod "ee88768f-e768-433f-b5e3-3fe42a6e3706" (UID: "ee88768f-e768-433f-b5e3-3fe42a6e3706"). InnerVolumeSpecName "kube-api-access-fdlfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:03:24.542537 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.542473    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee88768f-e768-433f-b5e3-3fe42a6e3706-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee88768f-e768-433f-b5e3-3fe42a6e3706" (UID: "ee88768f-e768-433f-b5e3-3fe42a6e3706"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:03:24.640969 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.640928    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee88768f-e768-433f-b5e3-3fe42a6e3706-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:24.640969 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.640961    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee88768f-e768-433f-b5e3-3fe42a6e3706-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:24.640969 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.640971    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdlfc\" (UniqueName: \"kubernetes.io/projected/ee88768f-e768-433f-b5e3-3fe42a6e3706-kube-api-access-fdlfc\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:24.875210 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.875116    2564 generic.go:356] "Generic (PLEG): container finished" podID="ee88768f-e768-433f-b5e3-3fe42a6e3706" containerID="542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e" exitCode=0
Jul 07 12:03:24.875210 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.875165    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"
Jul 07 12:03:24.875210 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.875199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk" event={"ID":"ee88768f-e768-433f-b5e3-3fe42a6e3706","Type":"ContainerDied","Data":"542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e"}
Jul 07 12:03:24.875731 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.875253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk" event={"ID":"ee88768f-e768-433f-b5e3-3fe42a6e3706","Type":"ContainerDied","Data":"9ceab4de3b13be9c4030030d47f1a2d54bdfa9b1a08407bb24dc7b742789966d"}
Jul 07 12:03:24.875731 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.875277    2564 scope.go:117] "RemoveContainer" containerID="542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e"
Jul 07 12:03:24.885131 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.885107    2564 scope.go:117] "RemoveContainer" containerID="542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e"
Jul 07 12:03:24.885398 ip-10-0-129-12 kubenswrapper[2564]: E0707 12:03:24.885379    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e\": container with ID starting with 542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e not found: ID does not exist" containerID="542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e"
Jul 07 12:03:24.885452 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.885407    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e"} err="failed to get container status \"542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e\": rpc error: code = NotFound desc = could not find container \"542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e\": container with ID starting with 542df6847f5980c7549d3bb39a8b5557df0753c6de756ff14691a2c118db7a6e not found: ID does not exist"
Jul 07 12:03:24.898190 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.898160    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"]
Jul 07 12:03:24.902126 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:24.902103    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02e907-5448d7784c-72xhk"]
Jul 07 12:03:25.418755 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:25.418721    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee88768f-e768-433f-b5e3-3fe42a6e3706" path="/var/lib/kubelet/pods/ee88768f-e768-433f-b5e3-3fe42a6e3706/volumes"
Jul 07 12:03:28.091773 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.091707    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:03:28.178976 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.178941    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-envoy\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179176 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.178999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-certs\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179176 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179023    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-credential-socket\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179176 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-data\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179176 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179093    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-podinfo\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179176 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179127    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istiod-ca-cert\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179439 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179187    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-socket\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179439 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179216    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs84w\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-kube-api-access-rs84w\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179439 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179246    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-token\") pod \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\" (UID: \"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f\") "
Jul 07 12:03:28.179439 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179403    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:03:28.179663 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179475    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:03:28.179663 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179583    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:03:28.179663 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179589    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.179996 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179722    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:03:28.179996 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.179740    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.180138 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.180114    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:03:28.181400 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.181373    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:03:28.181671 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.181625    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:03:28.181980 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.181958    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-kube-api-access-rs84w" (OuterVolumeSpecName: "kube-api-access-rs84w") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "kube-api-access-rs84w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:03:28.182048 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.181958    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" (UID: "8d84e9ba-4d32-4f4c-b0a2-84cc5075831f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 12:03:28.280857 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.280813    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.280857 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.280849    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.280857 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.280859    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.280857 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.280867    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.281134 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.280875    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs84w\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-kube-api-access-rs84w\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.281134 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.280885    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.281134 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.280893    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:03:28.900112 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.900080    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerID="28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc" exitCode=0
Jul 07 12:03:28.900292 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.900136    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"
Jul 07 12:03:28.900292 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.900163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" event={"ID":"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f","Type":"ContainerDied","Data":"28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc"}
Jul 07 12:03:28.900292 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.900224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v" event={"ID":"8d84e9ba-4d32-4f4c-b0a2-84cc5075831f","Type":"ContainerDied","Data":"5cf7ccdad07c67dee9dd40f419619be0fb7f7bf93cde546dcb18f9206b6a57a1"}
Jul 07 12:03:28.900292 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.900254    2564 scope.go:117] "RemoveContainer" containerID="28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc"
Jul 07 12:03:28.910220 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.910203    2564 scope.go:117] "RemoveContainer" containerID="f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc"
Jul 07 12:03:28.918936 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.918915    2564 scope.go:117] "RemoveContainer" containerID="28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc"
Jul 07 12:03:28.919282 ip-10-0-129-12 kubenswrapper[2564]: E0707 12:03:28.919262    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc\": container with ID starting with 28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc not found: ID does not exist" containerID="28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc"
Jul 07 12:03:28.919340 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.919295    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc"} err="failed to get container status \"28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc\": rpc error: code = NotFound desc = could not find container \"28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc\": container with ID starting with 28ec828ae3b5d109267959f53cd247946fa76eb9e12a2babe184c33e766726bc not found: ID does not exist"
Jul 07 12:03:28.919382 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.919361    2564 scope.go:117] "RemoveContainer" containerID="f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc"
Jul 07 12:03:28.919856 ip-10-0-129-12 kubenswrapper[2564]: E0707 12:03:28.919789    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc\": container with ID starting with f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc not found: ID does not exist" containerID="f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc"
Jul 07 12:03:28.919856 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.919828    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc"} err="failed to get container status \"f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc\": rpc error: code = NotFound desc = could not find container \"f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc\": container with ID starting with f9dbac4d91bd6c135da17792612ceb68f5167e9f0e75d31926b84f438b736edc not found: ID does not exist"
Jul 07 12:03:28.922270 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.922247    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"]
Jul 07 12:03:28.926708 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:28.926684    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-302b88-openshift-default-5d6bc6fd99-kqc5v"]
Jul 07 12:03:29.419175 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:29.419141    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" path="/var/lib/kubelet/pods/8d84e9ba-4d32-4f4c-b0a2-84cc5075831f/volumes"
Jul 07 12:03:29.830145 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:29.830063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:29.888307 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:29.888275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:29.953752 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:29.953717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:30.169217 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.169187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:30.667986 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.667956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:30.808116 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808076    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"]
Jul 07 12:03:30.808669 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808653    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy"
Jul 07 12:03:30.808736 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808671    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy"
Jul 07 12:03:30.808736 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808687    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy"
Jul 07 12:03:30.808736 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808692    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy"
Jul 07 12:03:30.808736 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808700    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee88768f-e768-433f-b5e3-3fe42a6e3706" containerName="maas-api"
Jul 07 12:03:30.808736 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808707    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee88768f-e768-433f-b5e3-3fe42a6e3706" containerName="maas-api"
Jul 07 12:03:30.808888 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808776    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy"
Jul 07 12:03:30.808888 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.808791    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee88768f-e768-433f-b5e3-3fe42a6e3706" containerName="maas-api"
Jul 07 12:03:30.811991 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.811975    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.824362 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.824343    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ecfb77-openshift-default-dockercfg-kckhd\""
Jul 07 12:03:30.825016 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.824999    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 12:03:30.835673 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.835647    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"]
Jul 07 12:03:30.850560 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.850526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:30.906594 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-podinfo\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.906806 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-credential-socket\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.906806 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-data\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.906806 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-certs\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.906806 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istiod-ca-cert\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.907037 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-token\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.907037 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-envoy\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.907037 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.906968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-socket\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:30.907037 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:30.907029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhrgh\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-kube-api-access-nhrgh\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007581 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-token\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007581 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-envoy\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007581 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-socket\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007913 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhrgh\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-kube-api-access-nhrgh\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007913 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-podinfo\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007913 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-credential-socket\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007913 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-data\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007913 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-certs\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.007913 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.007816    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istiod-ca-cert\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.008219 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.008156    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-certs\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.008219 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.008161    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-data\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.008325 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.008217    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-credential-socket\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.008382 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.008346    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-socket\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.008572 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.008548    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istiod-ca-cert\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.010094 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.010069    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-envoy\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.010310 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.010293    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-podinfo\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.016208 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.016185    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-token\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.016355 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.016317    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhrgh\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-kube-api-access-nhrgh\") pod \"e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") " pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.122551 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.122510    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:31.284728 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.284579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"]
Jul 07 12:03:31.289485 ip-10-0-129-12 kubenswrapper[2564]: W0707 12:03:31.289458    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3483d93_57e5_4041_9e04_7d8d95e2ecff.slice/crio-12af7b696a298da52abc085c668ddd50dd116e4568277d986747a2b25309439f WatchSource:0}: Error finding container 12af7b696a298da52abc085c668ddd50dd116e4568277d986747a2b25309439f: Status 404 returned error can't find the container with id 12af7b696a298da52abc085c668ddd50dd116e4568277d986747a2b25309439f
Jul 07 12:03:31.291431 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.291385    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:03:31.291493 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.291464    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:03:31.291537 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.291491    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:03:31.390543 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.390505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:31.920100 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.920052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" event={"ID":"b3483d93-57e5-4041-9e04-7d8d95e2ecff","Type":"ContainerStarted","Data":"5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74"}
Jul 07 12:03:31.920500 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.920159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" event={"ID":"b3483d93-57e5-4041-9e04-7d8d95e2ecff","Type":"ContainerStarted","Data":"12af7b696a298da52abc085c668ddd50dd116e4568277d986747a2b25309439f"}
Jul 07 12:03:31.940761 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:31.940712    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podStartSLOduration=1.940693515 podStartE2EDuration="1.940693515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:03:31.939185044 +0000 UTC m=+2194.978409746" watchObservedRunningTime="2026-07-07 12:03:31.940693515 +0000 UTC m=+2194.979918215"
Jul 07 12:03:32.123497 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:32.123451    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:32.128420 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:32.128391    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:32.926471 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:32.926439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:32.927456 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:32.927442    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:33.864119 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:33.864084    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:33.943056 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:33.943018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:34.015918 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:34.015885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:34.112747 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:34.112710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:34.734538 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:34.734502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:34.830532 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:34.830443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:38.360387 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:38.360357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:38.818893 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:38.818865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:39.114670 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:39.114565    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:39.297352 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:39.297313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:42.446932 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:42.446897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:42.540012 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:42.539979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:42.692415 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:42.692369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:43.195463 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:43.195426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:43.306492 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:43.306458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:43.406873 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:43.406835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:46.938463 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:46.938420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:48.968858 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:48.968810    2564 patch_prober.go:28] interesting pod/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 12:03:48.969284 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:48.968895    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 12:03:50.029384 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:50.029291    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerID="5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74" exitCode=0
Jul 07 12:03:50.029384 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:50.029361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" event={"ID":"b3483d93-57e5-4041-9e04-7d8d95e2ecff","Type":"ContainerDied","Data":"5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74"}
Jul 07 12:03:50.029873 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:50.029836    2564 scope.go:117] "RemoveContainer" containerID="5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74"
Jul 07 12:03:50.030954 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:50.030927    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:03:50.031034 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:50.030992    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:03:50.031034 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:50.031023    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:03:51.036842 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:51.036800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" event={"ID":"b3483d93-57e5-4041-9e04-7d8d95e2ecff","Type":"ContainerStarted","Data":"bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4"}
Jul 07 12:03:51.123341 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:51.123305    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:51.123609 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:51.123584    2564 patch_prober.go:28] interesting pod/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 07 12:03:51.123683 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:51.123660    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 07 12:03:52.123706 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:52.123669    2564 patch_prober.go:28] interesting pod/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 07 12:03:52.124086 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:52.123723    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 07 12:03:53.123307 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:53.123266    2564 patch_prober.go:28] interesting pod/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 07 12:03:53.123492 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:53.123328    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 07 12:03:54.123077 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:54.123038    2564 patch_prober.go:28] interesting pod/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 07 12:03:54.123542 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:54.123100    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 07 12:03:54.980901 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:54.980837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:55.123046 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:55.123005    2564 patch_prober.go:28] interesting pod/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 07 12:03:55.123230 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:55.123081    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 07 12:03:55.391843 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:55.391725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:55.492047 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:55.492009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:55.624901 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:55.624856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:03:56.126897 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:56.126866    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:56.127304 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:56.127150    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:03:56.127860 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:03:56.127844    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:04:01.219819 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:01.219788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:01.278727 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:01.278689    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:01.457615 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:01.457581    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"]
Jul 07 12:04:01.457875 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:01.457849    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy" containerID="cri-o://bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4" gracePeriod=30
Jul 07 12:04:01.480277 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:01.480192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:01.694683 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:01.694621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:02.043741 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:02.043708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:02.359136 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:02.359051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:02.461398 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:02.461365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:02.562232 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:02.562188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:02.713689 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:02.713610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:06.747890 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.747862    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:04:06.844856 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.844818    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-data\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.844873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-certs\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.844897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-socket\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.844928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-envoy\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.844954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-podinfo\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.844971    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhrgh\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-kube-api-access-nhrgh\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845023    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istiod-ca-cert\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845049 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845046    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-token\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845443 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-credential-socket\") pod \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\" (UID: \"b3483d93-57e5-4041-9e04-7d8d95e2ecff\") "
Jul 07 12:04:06.845443 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845173    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:04:06.845443 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845303    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:04:06.845443 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845377    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.845708 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845575    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:04:06.845771 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845722    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:04:06.845951 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.845802    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:04:06.847463 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.847430    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 12:04:06.847573 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.847470    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-kube-api-access-nhrgh" (OuterVolumeSpecName: "kube-api-access-nhrgh") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "kube-api-access-nhrgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:04:06.847884 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.847854    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:04:06.847884 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.847860    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3483d93-57e5-4041-9e04-7d8d95e2ecff" (UID: "b3483d93-57e5-4041-9e04-7d8d95e2ecff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:04:06.945844 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945813    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.945844 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945840    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.945844 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945849    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.946080 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945858    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.946080 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945867    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.946080 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945874    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.946080 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945881    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3483d93-57e5-4041-9e04-7d8d95e2ecff-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:06.946080 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:06.945889    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhrgh\" (UniqueName: \"kubernetes.io/projected/b3483d93-57e5-4041-9e04-7d8d95e2ecff-kube-api-access-nhrgh\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:04:07.138508 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.138425    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerID="bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4" exitCode=0
Jul 07 12:04:07.138508 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.138474    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"
Jul 07 12:04:07.138727 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.138510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" event={"ID":"b3483d93-57e5-4041-9e04-7d8d95e2ecff","Type":"ContainerDied","Data":"bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4"}
Jul 07 12:04:07.138727 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.138593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw" event={"ID":"b3483d93-57e5-4041-9e04-7d8d95e2ecff","Type":"ContainerDied","Data":"12af7b696a298da52abc085c668ddd50dd116e4568277d986747a2b25309439f"}
Jul 07 12:04:07.138727 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.138617    2564 scope.go:117] "RemoveContainer" containerID="bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4"
Jul 07 12:04:07.148849 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.148829    2564 scope.go:117] "RemoveContainer" containerID="5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74"
Jul 07 12:04:07.157376 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.157357    2564 scope.go:117] "RemoveContainer" containerID="bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4"
Jul 07 12:04:07.157716 ip-10-0-129-12 kubenswrapper[2564]: E0707 12:04:07.157696    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4\": container with ID starting with bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4 not found: ID does not exist" containerID="bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4"
Jul 07 12:04:07.157772 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.157726    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4"} err="failed to get container status \"bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4\": rpc error: code = NotFound desc = could not find container \"bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4\": container with ID starting with bd9849307545717d22790515b7e257f4eb4a1146a4adaacebf23dddba20fe2c4 not found: ID does not exist"
Jul 07 12:04:07.157772 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.157744    2564 scope.go:117] "RemoveContainer" containerID="5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74"
Jul 07 12:04:07.158005 ip-10-0-129-12 kubenswrapper[2564]: E0707 12:04:07.157986    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74\": container with ID starting with 5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74 not found: ID does not exist" containerID="5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74"
Jul 07 12:04:07.158048 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.158012    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74"} err="failed to get container status \"5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74\": rpc error: code = NotFound desc = could not find container \"5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74\": container with ID starting with 5bb5624898ce804a553f1e11c78f3107943b904903aadc38cac2585d2195ea74 not found: ID does not exist"
Jul 07 12:04:07.162869 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.162838    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"]
Jul 07 12:04:07.166114 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.166088    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ecfb77-openshift-default-7c49b8f987-fnqcw"]
Jul 07 12:04:07.419324 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:07.419294    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" path="/var/lib/kubelet/pods/b3483d93-57e5-4041-9e04-7d8d95e2ecff/volumes"
Jul 07 12:04:08.224006 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:08.223977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:08.323945 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:08.323913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:08.474872 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:08.474774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:08.730358 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:08.730274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:09.022999 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.022917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:09.296354 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296260    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"]
Jul 07 12:04:09.296834 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296726    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy"
Jul 07 12:04:09.296834 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296740    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy"
Jul 07 12:04:09.296834 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296752    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy"
Jul 07 12:04:09.296834 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296758    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy"
Jul 07 12:04:09.297053 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296839    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d84e9ba-4d32-4f4c-b0a2-84cc5075831f" containerName="istio-proxy"
Jul 07 12:04:09.297053 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296850    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy"
Jul 07 12:04:09.297053 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.296857    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3483d93-57e5-4041-9e04-7d8d95e2ecff" containerName="istio-proxy"
Jul 07 12:04:09.301612 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.301587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.304241 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.304219    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 12:04:09.304495 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.304473    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-10f898-openshift-default-dockercfg-sp9c7\""
Jul 07 12:04:09.312794 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.312771    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"]
Jul 07 12:04:09.330072 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.330044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:09.367383 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-podinfo\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367590 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istiod-ca-cert\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367590 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-data\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367590 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwzdn\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-kube-api-access-cwzdn\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367803 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-envoy\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367803 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-credential-socket\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367908 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-token\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367908 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-socket\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.367908 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.367875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-certs\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469156 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-data\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469344 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwzdn\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-kube-api-access-cwzdn\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469344 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-envoy\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469344 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-credential-socket\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469344 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-token\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469344 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-socket\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469344 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-certs\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469667 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-podinfo\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469734 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469617    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-data\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469779 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469735    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-credential-socket\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469779 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469765    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-socket\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.469880 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.469820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istiod-ca-cert\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.470061 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.470033    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-certs\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.470446 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.470424    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istiod-ca-cert\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.471905 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.471881    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-envoy\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.472235 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.472214    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-podinfo\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.477912 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.477890    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-token\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.478322 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.478305    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwzdn\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-kube-api-access-cwzdn\") pod \"e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") " pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.613733 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.613602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:09.710470 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.710411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:09.766321 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.766293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"]
Jul 07 12:04:09.770036 ip-10-0-129-12 kubenswrapper[2564]: W0707 12:04:09.769965    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08354bd8_7cd2_41a4_82a0_d361f21aa42a.slice/crio-671197e262a0317334adddac721b1b90d86f459619996cd3b73b57d0bea57a31 WatchSource:0}: Error finding container 671197e262a0317334adddac721b1b90d86f459619996cd3b73b57d0bea57a31: Status 404 returned error can't find the container with id 671197e262a0317334adddac721b1b90d86f459619996cd3b73b57d0bea57a31
Jul 07 12:04:09.772747 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.772698    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:04:09.772844 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.772794    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:04:09.772844 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:09.772834    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:04:10.158561 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:10.158525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" event={"ID":"08354bd8-7cd2-41a4-82a0-d361f21aa42a","Type":"ContainerStarted","Data":"959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613"}
Jul 07 12:04:10.158807 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:10.158580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" event={"ID":"08354bd8-7cd2-41a4-82a0-d361f21aa42a","Type":"ContainerStarted","Data":"671197e262a0317334adddac721b1b90d86f459619996cd3b73b57d0bea57a31"}
Jul 07 12:04:10.180706 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:10.180655    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podStartSLOduration=1.180624104 podStartE2EDuration="1.180624104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:04:10.17819466 +0000 UTC m=+2233.217419384" watchObservedRunningTime="2026-07-07 12:04:10.180624104 +0000 UTC m=+2233.219848804"
Jul 07 12:04:10.614388 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:10.614342    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:10.619696 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:10.619669    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:11.167238 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:11.167204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:11.168438 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:11.168417    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:12.050916 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:12.050882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:12.148181 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:12.148148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:12.249889 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:12.249853    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:12.712740 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:12.712710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:12.813549 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:12.813518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:12.916366 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:12.916331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:16.530580 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:16.530549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:16.896829 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:16.896741    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:17.174898 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:17.174866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:17.543388 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:17.543283    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:19.664183 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:19.664145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:19.764306 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:19.764255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:19.825956 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:19.825929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:19.988469 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:19.988430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:20.446970 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:20.446942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:20.544697 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:20.544656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:24.161772 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:24.161731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:26.168469 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.168424    2564 patch_prober.go:28] interesting pod/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 12:04:26.168884 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.168514    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 12:04:26.252608 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.252525    2564 generic.go:356] "Generic (PLEG): container finished" podID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerID="959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613" exitCode=0
Jul 07 12:04:26.252789 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.252601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" event={"ID":"08354bd8-7cd2-41a4-82a0-d361f21aa42a","Type":"ContainerDied","Data":"959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613"}
Jul 07 12:04:26.253055 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.253040    2564 scope.go:117] "RemoveContainer" containerID="959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613"
Jul 07 12:04:26.254210 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.254181    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:04:26.254295 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.254271    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:04:26.254355 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.254311    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 12:04:26.633996 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.633903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:26.731709 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:26.731678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:27.262144 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:27.262098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" event={"ID":"08354bd8-7cd2-41a4-82a0-d361f21aa42a","Type":"ContainerStarted","Data":"760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c"}
Jul 07 12:04:27.351538 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:27.351496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:27.614043 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:27.613970    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:27.614208 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:27.614183    2564 patch_prober.go:28] interesting pod/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 12:04:27.614264 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:27.614242    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 12:04:28.614114 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:28.614068    2564 patch_prober.go:28] interesting pod/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 12:04:28.614510 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:28.614133    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 12:04:29.614010 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:29.613973    2564 patch_prober.go:28] interesting pod/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 12:04:29.614199 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:29.614043    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 12:04:30.614470 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:30.614434    2564 patch_prober.go:28] interesting pod/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 07 12:04:30.615019 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:30.614490    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 07 12:04:31.618625 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:31.618590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:31.619117 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:31.618979    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:31.619868 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:31.619846    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:04:33.442742 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:33.442699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:33.545014 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:33.542276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:41.297241 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:41.297195    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:41.397010 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:41.396973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:04:44.439741 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:04:44.439712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:06:08.737584 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:06:08.737506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:06:36.031244 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:06:36.031200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:06:37.015960 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:06:37.015922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:06:46.443667 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:06:46.443605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:06:57.591317 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:06:57.591282    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 12:06:57.634335 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:06:57.634308    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv8qm_df2f33ec-9916-4121-9318-73d89408535c/ovn-acl-logging/0.log"
Jul 07 12:07:06.755290 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:07:06.755256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:07:53.952212 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:07:53.952181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:07:54.982609 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:07:54.982554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:08:09.649377 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:08:09.649344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:08:44.562821 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:08:44.562788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:27.342767 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:27.342733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:27.439785 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:27.439745    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:27.754138 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:27.754109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:28.757294 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:28.757249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:30.135994 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:30.135963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:32.232653 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:32.232585    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:32.367990 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:32.367959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:35.561165 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:35.561130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:41.973488 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:41.973451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:09:42.074118 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:09:42.074083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:12.407042 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:12.407006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:12.663018 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:12.662925    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"]
Jul 07 12:10:12.663207 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:12.663184    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy" containerID="cri-o://760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c" gracePeriod=30
Jul 07 12:10:12.680768 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:12.680739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:12.954334 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:12.954300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:13.119436 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:13.119398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:13.434419 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:13.434386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:13.535189 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:13.535156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:16.621997 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:16.621950    2564 patch_prober.go:28] interesting pod/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 12:10:16.622453 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:16.622035    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 12:10:17.932160 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.932103    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:10:17.997949 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.997912    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-credential-socket\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998135 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998003    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-podinfo\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998135 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998029    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-data\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998135 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998052    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-envoy\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998135 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998080    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-certs\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998359 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998135    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-token\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998359 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwzdn\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-kube-api-access-cwzdn\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998359 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-socket\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998359 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998193    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:10:17.998359 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998228    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istiod-ca-cert\") pod \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\" (UID: \"08354bd8-7cd2-41a4-82a0-d361f21aa42a\") "
Jul 07 12:10:17.998603 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998443    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:10:17.998603 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998576    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:17.998603 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998596    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:17.998811 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.998786    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:10:17.999047 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.999022    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:10:17.999190 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:17.999166    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-data" (OuterVolumeSpecName: "istio-data") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:10:18.000499 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.000464    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 12:10:18.000499 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.000475    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-kube-api-access-cwzdn" (OuterVolumeSpecName: "kube-api-access-cwzdn") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "kube-api-access-cwzdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:10:18.000881 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.000864    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 12:10:18.000949 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.000914    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-token" (OuterVolumeSpecName: "istio-token") pod "08354bd8-7cd2-41a4-82a0-d361f21aa42a" (UID: "08354bd8-7cd2-41a4-82a0-d361f21aa42a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:10:18.099897 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.099867    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:18.099897 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.099896    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:18.099897 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.099908    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:18.100151 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.099920    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:18.100151 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.099933    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwzdn\" (UniqueName: \"kubernetes.io/projected/08354bd8-7cd2-41a4-82a0-d361f21aa42a-kube-api-access-cwzdn\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:18.100151 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.099945    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08354bd8-7cd2-41a4-82a0-d361f21aa42a-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:18.100151 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.099956    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08354bd8-7cd2-41a4-82a0-d361f21aa42a-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 07 12:10:18.268137 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.268034    2564 generic.go:356] "Generic (PLEG): container finished" podID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerID="760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c" exitCode=0
Jul 07 12:10:18.268137 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.268095    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"
Jul 07 12:10:18.268137 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.268125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" event={"ID":"08354bd8-7cd2-41a4-82a0-d361f21aa42a","Type":"ContainerDied","Data":"760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c"}
Jul 07 12:10:18.268429 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.268191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v" event={"ID":"08354bd8-7cd2-41a4-82a0-d361f21aa42a","Type":"ContainerDied","Data":"671197e262a0317334adddac721b1b90d86f459619996cd3b73b57d0bea57a31"}
Jul 07 12:10:18.268429 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.268224    2564 scope.go:117] "RemoveContainer" containerID="760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c"
Jul 07 12:10:18.278813 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.278794    2564 scope.go:117] "RemoveContainer" containerID="959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613"
Jul 07 12:10:18.288347 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.288330    2564 scope.go:117] "RemoveContainer" containerID="760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c"
Jul 07 12:10:18.288550 ip-10-0-129-12 kubenswrapper[2564]: E0707 12:10:18.288530    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c\": container with ID starting with 760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c not found: ID does not exist" containerID="760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c"
Jul 07 12:10:18.288588 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.288558    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c"} err="failed to get container status \"760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c\": rpc error: code = NotFound desc = could not find container \"760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c\": container with ID starting with 760ef8148de4f5d937f6be39bcb00e33f60efa47ade68bb0b6fe4c0e7dfa6a9c not found: ID does not exist"
Jul 07 12:10:18.288588 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.288574    2564 scope.go:117] "RemoveContainer" containerID="959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613"
Jul 07 12:10:18.288831 ip-10-0-129-12 kubenswrapper[2564]: E0707 12:10:18.288812    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613\": container with ID starting with 959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613 not found: ID does not exist" containerID="959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613"
Jul 07 12:10:18.288896 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.288840    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613"} err="failed to get container status \"959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613\": rpc error: code = NotFound desc = could not find container \"959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613\": container with ID starting with 959d1ef62851224a8cc6845d069fb50aa18730aa10e0bde96057e58e69a1c613 not found: ID does not exist"
Jul 07 12:10:18.292196 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.292169    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"]
Jul 07 12:10:18.296141 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:18.296120    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-10f898-openshift-default-9677464c5-t4z8v"]
Jul 07 12:10:19.418564 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:19.418525    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" path="/var/lib/kubelet/pods/08354bd8-7cd2-41a4-82a0-d361f21aa42a/volumes"
Jul 07 12:10:20.357506 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:20.357469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd4b78985-rstz8_a112f96d-5f20-4f6c-a26f-0268bfb4e273/authorino/0.log"
Jul 07 12:10:20.919992 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:20.919957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:21.021362 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:21.021332    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:25.063840 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:25.063801    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b4qrv_2b269b83-9145-4503-bc2a-fb988d962e0b/manager/0.log"
Jul 07 12:10:25.186568 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:25.186537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5cdjr_0ad07db8-4076-4917-89d9-7ab944bbfe81/manager/0.log"
Jul 07 12:10:25.309616 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:25.309587    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cbb5657bc-qhrws_18adc6d1-8ed1-4ee7-948f-356b2d6d01b0/maas-api/0.log"
Jul 07 12:10:25.425383 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:25.425348    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723745-tv9xx_f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee/cleanup/0.log"
Jul 07 12:10:25.534400 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:25.534368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723760-drztt_17fa6179-d954-4ec0-997d-fc2bf0426e89/cleanup/0.log"
Jul 07 12:10:25.653968 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:25.653942    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ffd5b775c-pxx6n_1562dfa9-ef2e-4421-9e72-a82504a83dcd/manager/0.log"
Jul 07 12:10:25.906421 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:25.906345    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cgsn5_01823f9a-5c90-4478-848a-b208719e3737/manager/0.log"
Jul 07 12:10:26.183055 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:26.183028    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f68d9489b-tk7rh_245ae191-49eb-42ae-af53-03c4d7899214/copy-manifests/0.log"
Jul 07 12:10:26.189274 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:26.189251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f68d9489b-tk7rh_245ae191-49eb-42ae-af53-03c4d7899214/manager/0.log"
Jul 07 12:10:26.414846 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:26.414818    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bm8vd_1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6/postgres/0.log"
Jul 07 12:10:27.755262 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:27.755232    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd4b78985-rstz8_a112f96d-5f20-4f6c-a26f-0268bfb4e273/authorino/0.log"
Jul 07 12:10:27.878695 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:27.878668    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8gj7b_7fd799f9-00b7-40f3-9c99-ff3f32bcbca5/manager/0.log"
Jul 07 12:10:27.988328 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:27.988300    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zkp2h_b115d5b8-e2a1-4fc3-8a66-f62a3d52d047/manager/0.log"
Jul 07 12:10:28.096666 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:28.096566    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zv6bj_909d8717-657e-41c7-bb1b-5b0dcd115b0e/kuadrant-console-plugin/0.log"
Jul 07 12:10:28.211936 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:28.211902    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g2rsp_95ede532-ded5-4aef-93c6-39b74e6ddd9a/registry-server/0.log"
Jul 07 12:10:28.338140 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:28.338108    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7n6dc_de31ed77-ddec-4555-a5a4-1a6815ffb465/manager/0.log"
Jul 07 12:10:28.580902 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:28.580872    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g847w_6031e811-52cf-40e7-a97d-892ba6392334/manager/0.log"
Jul 07 12:10:29.253072 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:29.253031    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5474cb5f94-qx7pl_50e67c32-06a6-4230-8bac-4bb6b79b0eb1/kube-auth-proxy/0.log"
Jul 07 12:10:29.488197 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:29.488166    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rtjxt_07f15135-9e8d-486b-825b-44cbc1357007/payload-pre-processing/0.log"
Jul 07 12:10:29.610311 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:29.610232    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6lb_8670c32e-78d4-4669-8ddd-846c382c00bc/payload-processing/0.log"
Jul 07 12:10:30.181100 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:30.181063    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2hnft_b2ac4281-d67c-40a7-88d7-9831584a75cd/main/0.log"
Jul 07 12:10:34.662703 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.662669    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbjbt/must-gather-9mttg"]
Jul 07 12:10:34.663130 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.663117    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy"
Jul 07 12:10:34.663178 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.663132    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy"
Jul 07 12:10:34.663226 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.663217    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy"
Jul 07 12:10:34.663264 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.663230    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy"
Jul 07 12:10:34.663297 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.663290    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy"
Jul 07 12:10:34.663297 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.663296    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="08354bd8-7cd2-41a4-82a0-d361f21aa42a" containerName="istio-proxy"
Jul 07 12:10:34.666608 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.666587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:34.669380 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.669356    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbjbt\"/\"kube-root-ca.crt\""
Jul 07 12:10:34.670512 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.670491    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vbjbt\"/\"default-dockercfg-x8ms6\""
Jul 07 12:10:34.670661 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.670508    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbjbt\"/\"openshift-service-ca.crt\""
Jul 07 12:10:34.675376 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.675347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:34.677054 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.677029    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbjbt/must-gather-9mttg"]
Jul 07 12:10:34.741258 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.741220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log" limit=1024
Jul 07 12:10:34.758731 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.758689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjdh\" (UniqueName: \"kubernetes.io/projected/fbbe5128-9e91-42c8-bb08-0d49d43c93b7-kube-api-access-qrjdh\") pod \"must-gather-9mttg\" (UID: \"fbbe5128-9e91-42c8-bb08-0d49d43c93b7\") " pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:34.758891 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.758801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbbe5128-9e91-42c8-bb08-0d49d43c93b7-must-gather-output\") pod \"must-gather-9mttg\" (UID: \"fbbe5128-9e91-42c8-bb08-0d49d43c93b7\") " pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:34.860064 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.860026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbbe5128-9e91-42c8-bb08-0d49d43c93b7-must-gather-output\") pod \"must-gather-9mttg\" (UID: \"fbbe5128-9e91-42c8-bb08-0d49d43c93b7\") " pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:34.860222 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.860108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjdh\" (UniqueName: \"kubernetes.io/projected/fbbe5128-9e91-42c8-bb08-0d49d43c93b7-kube-api-access-qrjdh\") pod \"must-gather-9mttg\" (UID: \"fbbe5128-9e91-42c8-bb08-0d49d43c93b7\") " pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:34.860380 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.860360    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fbbe5128-9e91-42c8-bb08-0d49d43c93b7-must-gather-output\") pod \"must-gather-9mttg\" (UID: \"fbbe5128-9e91-42c8-bb08-0d49d43c93b7\") " pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:34.868432 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.868403    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjdh\" (UniqueName: \"kubernetes.io/projected/fbbe5128-9e91-42c8-bb08-0d49d43c93b7-kube-api-access-qrjdh\") pod \"must-gather-9mttg\" (UID: \"fbbe5128-9e91-42c8-bb08-0d49d43c93b7\") " pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:34.977608 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:34.977567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbjbt/must-gather-9mttg"
Jul 07 12:10:35.123535 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:35.123501    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbjbt/must-gather-9mttg"]
Jul 07 12:10:35.125685 ip-10-0-129-12 kubenswrapper[2564]: W0707 12:10:35.125652    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbbe5128_9e91_42c8_bb08_0d49d43c93b7.slice/crio-cafdc90d1e61f9a6926b08564b51d37d9cf0043ef6e00ce0c1f8cc79d2a1c5e8 WatchSource:0}: Error finding container cafdc90d1e61f9a6926b08564b51d37d9cf0043ef6e00ce0c1f8cc79d2a1c5e8: Status 404 returned error can't find the container with id cafdc90d1e61f9a6926b08564b51d37d9cf0043ef6e00ce0c1f8cc79d2a1c5e8
Jul 07 12:10:35.127550 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:35.127530    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 12:10:35.365166 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:35.365067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbjbt/must-gather-9mttg" event={"ID":"fbbe5128-9e91-42c8-bb08-0d49d43c93b7","Type":"ContainerStarted","Data":"cafdc90d1e61f9a6926b08564b51d37d9cf0043ef6e00ce0c1f8cc79d2a1c5e8"}
Jul 07 12:10:36.374213 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:36.374159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbjbt/must-gather-9mttg" event={"ID":"fbbe5128-9e91-42c8-bb08-0d49d43c93b7","Type":"ContainerStarted","Data":"e000b172a51dae5b6c6d78439824f9e79f701273d75f27f8b70b11cff94d338c"}
Jul 07 12:10:37.383479 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:37.383444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbjbt/must-gather-9mttg" event={"ID":"fbbe5128-9e91-42c8-bb08-0d49d43c93b7","Type":"ContainerStarted","Data":"ce67d8ef255d0b26e675f8f7058ff018fe1a5fb66d074d1924bfa85ccbad0c6b"}
Jul 07 12:10:37.401527 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:37.401471    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbjbt/must-gather-9mttg" podStartSLOduration=2.378158225 podStartE2EDuration="3.401455151s" totalImagesPullingTime="1.023296926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:10:37.399022936 +0000 UTC m=+2620.438247660" watchObservedRunningTime="2026-07-07 12:10:37.401455151 +0000 UTC m=+2620.440679901"
Jul 07 12:10:37.844750 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:37.844702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vsp4z_f48c9095-444f-4e2f-9f5d-22fbe4305bf3/global-pull-secret-syncer/0.log"
Jul 07 12:10:37.895029 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:37.894994    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6mbks_fdcd27f4-fb84-4ca8-b2dd-6b7ac1e67e97/konnectivity-agent/0.log"
Jul 07 12:10:37.981515 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:37.981486    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-12.ec2.internal_01502c7c24216826a0dc843b8111a65b/haproxy/0.log"
Jul 07 12:10:42.912293 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:42.912134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bd4b78985-rstz8_a112f96d-5f20-4f6c-a26f-0268bfb4e273/authorino/0.log"
Jul 07 12:10:42.947506 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:42.947472    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8gj7b_7fd799f9-00b7-40f3-9c99-ff3f32bcbca5/manager/0.log"
Jul 07 12:10:42.983061 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:42.983027    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zkp2h_b115d5b8-e2a1-4fc3-8a66-f62a3d52d047/manager/0.log"
Jul 07 12:10:43.026894 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:43.026847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zv6bj_909d8717-657e-41c7-bb1b-5b0dcd115b0e/kuadrant-console-plugin/0.log"
Jul 07 12:10:43.069467 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:43.069429    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g2rsp_95ede532-ded5-4aef-93c6-39b74e6ddd9a/registry-server/0.log"
Jul 07 12:10:43.283652 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:43.283184    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7n6dc_de31ed77-ddec-4555-a5a4-1a6815ffb465/manager/0.log"
Jul 07 12:10:43.391657 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:43.389298    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g847w_6031e811-52cf-40e7-a97d-892ba6392334/manager/0.log"
Jul 07 12:10:44.938816 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:44.938779    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_44994288-e290-43cd-bbd1-51940a28251d/alertmanager/0.log"
Jul 07 12:10:44.963577 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:44.963538    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_44994288-e290-43cd-bbd1-51940a28251d/config-reloader/0.log"
Jul 07 12:10:44.984584 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:44.984558    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_44994288-e290-43cd-bbd1-51940a28251d/kube-rbac-proxy-web/0.log"
Jul 07 12:10:45.006303 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.006274    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_44994288-e290-43cd-bbd1-51940a28251d/kube-rbac-proxy/0.log"
Jul 07 12:10:45.029308 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.029264    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_44994288-e290-43cd-bbd1-51940a28251d/kube-rbac-proxy-metric/0.log"
Jul 07 12:10:45.051951 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.051926    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_44994288-e290-43cd-bbd1-51940a28251d/prom-label-proxy/0.log"
Jul 07 12:10:45.078180 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.078146    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_44994288-e290-43cd-bbd1-51940a28251d/init-config-reloader/0.log"
Jul 07 12:10:45.253707 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.253598    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-z7bds_9a5d68f6-e660-4762-ae78-7a68f03c9a7f/monitoring-plugin/0.log"
Jul 07 12:10:45.465209 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.465176    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfjqh_aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d/node-exporter/0.log"
Jul 07 12:10:45.489159 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.489125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfjqh_aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d/kube-rbac-proxy/0.log"
Jul 07 12:10:45.511504 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.511419    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfjqh_aaa8c1fa-1e3e-40ff-9a05-6c8a3519538d/init-textfile/0.log"
Jul 07 12:10:45.868107 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.868025    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dfcbb9b57-xl92w_fe87c6bb-4aee-4caf-8f8a-0dad72036f9e/telemeter-client/0.log"
Jul 07 12:10:45.892174 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.892112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dfcbb9b57-xl92w_fe87c6bb-4aee-4caf-8f8a-0dad72036f9e/reload/0.log"
Jul 07 12:10:45.919243 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.919209    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-dfcbb9b57-xl92w_fe87c6bb-4aee-4caf-8f8a-0dad72036f9e/kube-rbac-proxy/0.log"
Jul 07 12:10:45.950310 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.950283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786954f874-jzzw2_32fac2e8-b811-41d9-85e0-2eed643230c1/thanos-query/0.log"
Jul 07 12:10:45.974540 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:45.974504    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786954f874-jzzw2_32fac2e8-b811-41d9-85e0-2eed643230c1/kube-rbac-proxy-web/0.log"
Jul 07 12:10:46.003793 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:46.003764    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786954f874-jzzw2_32fac2e8-b811-41d9-85e0-2eed643230c1/kube-rbac-proxy/0.log"
Jul 07 12:10:46.037414 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:46.037375    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786954f874-jzzw2_32fac2e8-b811-41d9-85e0-2eed643230c1/prom-label-proxy/0.log"
Jul 07 12:10:46.065129 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:46.065104    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786954f874-jzzw2_32fac2e8-b811-41d9-85e0-2eed643230c1/kube-rbac-proxy-rules/0.log"
Jul 07 12:10:46.091384 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:46.091354    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-786954f874-jzzw2_32fac2e8-b811-41d9-85e0-2eed643230c1/kube-rbac-proxy-metrics/0.log"
Jul 07 12:10:48.436023 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.435987    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"]
Jul 07 12:10:48.442398 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.442369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.451906 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.451874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"]
Jul 07 12:10:48.529284 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.529249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-podres\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.529569 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.529552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-proc\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.529765 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.529751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-sys\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.529904 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.529890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdzqz\" (UniqueName: \"kubernetes.io/projected/bf744fb6-38eb-48a0-bb30-c0602e9819cc-kube-api-access-kdzqz\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.530050 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.530038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-lib-modules\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.630691 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-proc\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.630890 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-sys\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.630890 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdzqz\" (UniqueName: \"kubernetes.io/projected/bf744fb6-38eb-48a0-bb30-c0602e9819cc-kube-api-access-kdzqz\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.630890 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630796    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-proc\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.630890 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630844    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-sys\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.630890 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-lib-modules\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.631161 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-podres\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.631161 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.630974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-lib-modules\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.631161 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.631061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf744fb6-38eb-48a0-bb30-c0602e9819cc-podres\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.634646 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.634587    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-zb6jj_558ffcaf-ed44-4a54-bf1c-776c43133716/download-server/0.log"
Jul 07 12:10:48.640218 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.640181    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdzqz\" (UniqueName: \"kubernetes.io/projected/bf744fb6-38eb-48a0-bb30-c0602e9819cc-kube-api-access-kdzqz\") pod \"perf-node-gather-daemonset-ldzwg\" (UID: \"bf744fb6-38eb-48a0-bb30-c0602e9819cc\") " pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.765422 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.765334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:48.961128 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:48.961069    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"]
Jul 07 12:10:49.305145 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:49.305063    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-7lbgw_ad8806bd-26ac-4d34-99a0-623798a79866/volume-data-source-validator/0.log"
Jul 07 12:10:49.495961 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:49.495915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg" event={"ID":"bf744fb6-38eb-48a0-bb30-c0602e9819cc","Type":"ContainerStarted","Data":"81c2723719661bf74fd59927c1aefb43424d4e5d7350f4ebc240494122463d79"}
Jul 07 12:10:49.496417 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:49.495987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg" event={"ID":"bf744fb6-38eb-48a0-bb30-c0602e9819cc","Type":"ContainerStarted","Data":"f60444003340aae7a9a3564869a4ef3334b02751405af6395b108e46dcf7622b"}
Jul 07 12:10:49.496417 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:49.496019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:49.513210 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:49.513138    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg" podStartSLOduration=1.513120637 podStartE2EDuration="1.513120637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:10:49.512309445 +0000 UTC m=+2632.551534147" watchObservedRunningTime="2026-07-07 12:10:49.513120637 +0000 UTC m=+2632.552345341"
Jul 07 12:10:50.509185 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:50.509151    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dkzfh_4f9aaf7a-af6e-4a80-a12c-535f15c66f48/dns/0.log"
Jul 07 12:10:50.531147 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:50.531124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dkzfh_4f9aaf7a-af6e-4a80-a12c-535f15c66f48/kube-rbac-proxy/0.log"
Jul 07 12:10:50.556160 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:50.556117    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hqz5q_daa3b874-9544-44c5-8a23-e7d1a8d3893e/dns-node-resolver/0.log"
Jul 07 12:10:51.155993 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:51.155963    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57dfccbfb5-rp42q_e6bc5ec6-5d41-46e9-931c-088502c43320/registry/0.log"
Jul 07 12:10:51.178827 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:51.178795    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-89kg2_e2607803-14a5-4125-939d-8fe7b1e40de0/node-ca/0.log"
Jul 07 12:10:52.367061 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:52.367026    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5474cb5f94-qx7pl_50e67c32-06a6-4230-8bac-4bb6b79b0eb1/kube-auth-proxy/0.log"
Jul 07 12:10:52.484294 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:52.484262    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rtjxt_07f15135-9e8d-486b-825b-44cbc1357007/payload-pre-processing/0.log"
Jul 07 12:10:52.540966 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:52.540917    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6lb_8670c32e-78d4-4669-8ddd-846c382c00bc/payload-processing/0.log"
Jul 07 12:10:53.256808 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:53.256778    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7tt9g_2a5cb523-1c88-4b56-86c5-cb4a22987c5e/serve-healthcheck-canary/0.log"
Jul 07 12:10:53.785910 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:53.785885    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mllw2_639c05bf-4313-4162-bb4c-80f7771017e5/kube-rbac-proxy/0.log"
Jul 07 12:10:53.806998 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:53.806973    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mllw2_639c05bf-4313-4162-bb4c-80f7771017e5/exporter/0.log"
Jul 07 12:10:53.830384 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:53.830352    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mllw2_639c05bf-4313-4162-bb4c-80f7771017e5/extractor/0.log"
Jul 07 12:10:55.514792 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:55.514759    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vbjbt/perf-node-gather-daemonset-ldzwg"
Jul 07 12:10:56.145875 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.145849    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b4qrv_2b269b83-9145-4503-bc2a-fb988d962e0b/manager/0.log"
Jul 07 12:10:56.325460 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.325428    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5cdjr_0ad07db8-4076-4917-89d9-7ab944bbfe81/manager/0.log"
Jul 07 12:10:56.363088 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.363059    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cbb5657bc-qhrws_18adc6d1-8ed1-4ee7-948f-356b2d6d01b0/maas-api/0.log"
Jul 07 12:10:56.381672 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.381621    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723745-tv9xx_f8aebdd6-c157-4f64-8fd8-fba2c4fef3ee/cleanup/0.log"
Jul 07 12:10:56.405423 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.405355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723760-drztt_17fa6179-d954-4ec0-997d-fc2bf0426e89/cleanup/0.log"
Jul 07 12:10:56.530861 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.530817    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ffd5b775c-pxx6n_1562dfa9-ef2e-4421-9e72-a82504a83dcd/manager/0.log"
Jul 07 12:10:56.638316 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.638032    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-cgsn5_01823f9a-5c90-4478-848a-b208719e3737/manager/0.log"
Jul 07 12:10:56.756357 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.756323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f68d9489b-tk7rh_245ae191-49eb-42ae-af53-03c4d7899214/manager/0.log"
Jul 07 12:10:56.777726 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.777699    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f68d9489b-tk7rh_245ae191-49eb-42ae-af53-03c4d7899214/copy-manifests/0.log"
Jul 07 12:10:56.850339 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:56.850244    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bm8vd_1ea10bb8-cdb6-4e45-b0a7-4eb78b40cfd6/postgres/0.log"
Jul 07 12:10:58.384672 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:58.384613    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zg8v7_58f97344-66ac-48d3-808c-ee5b05d34a32/openshift-lws-operator/0.log"
Jul 07 12:10:59.111778 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:59.111746    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5474cb5f94-qx7pl_50e67c32-06a6-4230-8bac-4bb6b79b0eb1/kube-auth-proxy/0.log"
Jul 07 12:10:59.206844 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:59.206811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rtjxt_07f15135-9e8d-486b-825b-44cbc1357007/payload-pre-processing/0.log"
Jul 07 12:10:59.251474 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:10:59.251407    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6lb_8670c32e-78d4-4669-8ddd-846c382c00bc/payload-processing/0.log"
Jul 07 12:11:00.597162 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:00.597128    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5474cb5f94-qx7pl_50e67c32-06a6-4230-8bac-4bb6b79b0eb1/kube-auth-proxy/0.log"
Jul 07 12:11:00.705298 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:00.705212    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rtjxt_07f15135-9e8d-486b-825b-44cbc1357007/payload-pre-processing/0.log"
Jul 07 12:11:00.757186 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:00.757158    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dz6lb_8670c32e-78d4-4669-8ddd-846c382c00bc/payload-processing/0.log"
Jul 07 12:11:03.531514 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:03.531480    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lsm6m_70098997-dae5-4fcd-9f72-1a229dde987d/migrator/0.log"
Jul 07 12:11:03.551471 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:03.551442    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-lsm6m_70098997-dae5-4fcd-9f72-1a229dde987d/graceful-termination/0.log"
Jul 07 12:11:03.925361 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:03.925326    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vxqdm_43389efd-5b7c-4452-9af6-db603e7a8d69/kube-storage-version-migrator-operator/1.log"
Jul 07 12:11:03.926446 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:03.926418    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vxqdm_43389efd-5b7c-4452-9af6-db603e7a8d69/kube-storage-version-migrator-operator/0.log"
Jul 07 12:11:05.224308 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.224280    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4r9t_7761287c-1778-4853-be7c-8a1867dbb173/kube-multus-additional-cni-plugins/0.log"
Jul 07 12:11:05.244607 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.244574    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4r9t_7761287c-1778-4853-be7c-8a1867dbb173/egress-router-binary-copy/0.log"
Jul 07 12:11:05.264727 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.264702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4r9t_7761287c-1778-4853-be7c-8a1867dbb173/cni-plugins/0.log"
Jul 07 12:11:05.286155 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.286125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4r9t_7761287c-1778-4853-be7c-8a1867dbb173/bond-cni-plugin/0.log"
Jul 07 12:11:05.306796 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.306774    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4r9t_7761287c-1778-4853-be7c-8a1867dbb173/routeoverride-cni/0.log"
Jul 07 12:11:05.328351 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.328323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4r9t_7761287c-1778-4853-be7c-8a1867dbb173/whereabouts-cni-bincopy/0.log"
Jul 07 12:11:05.350622 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.350592    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4r9t_7761287c-1778-4853-be7c-8a1867dbb173/whereabouts-cni/0.log"
Jul 07 12:11:05.434995 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.434955    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sng86_f43c342d-9285-4c06-a913-c094d92a685a/kube-multus/0.log"
Jul 07 12:11:05.565253 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.565181    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s5js2_5f1eb45a-97c2-44fa-b2e8-4fde56f08886/network-metrics-daemon/0.log"
Jul 07 12:11:05.589153 ip-10-0-129-12 kubenswrapper[2564]: I0707 12:11:05.589124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s5js2_5f1eb45a-97c2-44fa-b2e8-4fde56f08886/kube-rbac-proxy/0.log"